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^^ ' Abstract. This paper extends the idea of E.Gobet, J.P.Lemor and X.Warin from the 

Cn , setting of Backward Stochastic Differential Equations to that of Backward Doubly Sto- 

chastic Differential equations. We propose some numerical approximation scheme of 
these equations introduced by E.Pardoux and S.Peng. 
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1. Introduction 



Since the pioneering work of E. Pardoux and S. Peng [TT], backward stochastic dif- 
ferential equations (BSDEs) have been intensively studied during the two last decades. 
Indeed, this notion has been a very useful tool to study problems in many areas, such as 
mathematical finance, stochastic control, partial differential equations; see e.g. [9] where 
many applications are described. Discretization schemes for BSDEs have been studied by 
several authors. The first papers on this topic are that of V. Bally [1] and D.Chevance 
[6]. In his thesis, J.Zhang made an interesting contribution which was the starting point 
of intense study among, which the works of B. Bouchard and N.Touzi [5], E.Gobet, J. P. 
jy~. ■ Lemor and X. Warin[^,... The notion of BSDE has been generalized by E. Pardoux and 

\^ ■ S. Peng [12] to that of Backward Doubly Stochastic Differential Equation (BDSDE) as 

follows. Let (r2,J-", P) be a probability space, T denote some fixed terminal time which 
C^^ ■ will be used throughout the paper, (VFt)o<f<T ^^^ i^t)o<t<T ^^ *^° independent standard 

^— ^ . Brownian motions defined on {Q,J^,F) and with values in R. On this space we will deal 

with the following families of <T-algebras: 



j;:=Jo^VjfrVAA, J-i:=J-o^VJ-o^rVAA, ?^t = Jq^ V J-,^^ V AA, (1.1) 

where J^^rp := a {Br — Bt;t < r < T), F^^ := a [Wr] < r < t) and N denotes the class of 

P null sets. We remark that (J-j) is a filtration, [T-Lt) is a decreasing family of a-albegras, 
while {J-t) is neither increasing nor decreasing. Given an initial condition x G M, let {Xt) 
be the diffusion process defined by 

Xt = x+ f b (Xs) ds+ f a {Xs) dWs. (1.2) 

Jo Jo 

Let S, G L'^{0,) be an M- valued, J^T^-measurable random variable, / and g be regular enough 
coefficients; consider the BDSDE defined as follows: 

Yt = C+ f f{s,Xs,Y„Zs)ds+ [ g{s,X,,Ys,Zs)dBs- f Z^dW^. (1.3) 

Jt Jt Jt 

In this equation, dW is the forward stochastic integral and dB is the backward stochastic 
integral (we send the reader to [10] for more details on backward integration). A solution 
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to (jl.3p is a pair of real- valued process (Yj, Z^), such that Yt and Zj are J"i-ineasurable for 
every t G [0,T], such that ()1.3p is satisfied and 

e( sup \Y,\'^)+E \Zs\'^ds < +00. (1.4) 

In [12] Pardoux and Peng have proved that under some Lipschitz property on / and g 
which will be stated later, p.3p has a unique solution (Y, Z). They also proved that 



\ \ Jt<s<TJ \ \ J t<s<T 

for some Borel functions u and v. 

The time discretization of BDSDEs has been addressed in [2j when the coefficient g does 
not depend on Z; see also [1] in the more general setting for g which may also depend on Z 
as in [12]. Both papers follow Zhang's approach and provide a theoretical approximation 
only using a constant time mesh. 

In order to obtain a more tractable discretization which could be implemented, a natural 
idea is to see whether the methods introduced in [7] can be extended from the framework 
of BSDEs to that more involved of BDSDEs ; this is the aim of this paper. 

We use three consecutive steps, and each time we give a precise estimate of the corre- 
sponding error. Thus, we start with a time discretization {Y{/ , Z^f) with a constant time 
mesh T/N . We can prove that 

where for A; = 1, . . . , A'^ — 1, t^ = kT/N and AB^ = Bt,^^-^ — Bt^. Furthermore, if either 
/ = or if the scheme is not implicit as in [1] then we have the more precise description: 



Af-l 
^N „.7V f, vN\ , V^ „.N ( , vN 



V„ V„ \ V 



j=k 

Zl = v^ {t,, X^J + Y, vf {t,,Xil, %B^.,, . . . , %B,^,) %B„ 

j=k 



with the convention that if j + 1 > A^ — 1, ( ABj^j^i, . . . , ABj^i] = 0. The main 



time discretization result in this direction is Theorem 13.41 In order to have a numeri- 
cal scheme, we use this decomposition and the ideas of E.Gobet, J.P.Lemor and X.Warin 
[7]. Thus we introduce the following hypercubes, that is approximate random variables 

u^ (tk,X^^, ABn-i, . . . , ABj^i j ABj by their orthogonal projection on some finite vec- 
tor space generated by some bases (uj) and (vj) defined below. For k = 1, . . . , N we have 



N-l / 

j=k ijv,ijv-iv:«j \ 



AB^ 

Vh 



<-„ \ "^B. 



UiN {X!t) v^J,_, [ABn-i) . ..v,,^, [ABj+iJ -^. 

We use a linear regression operator of the approximate solution. Thus, we at first use 
an orthogonal projection on a finite dimensional space Vk- This space consists in linear 
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combinations of an orthonornial family of properly renormalized indicator functions of 
disjoint intervals composed either with the diffusion X or with increments of the Brownian 
motion B. As in [7], in order not to introduce error terms worse that those due to the 
time discretization, we furtherore have to use a Picard iteration scheme. The error due to 
this regression operator is estimated in Theorem 14. 1[ 

Then the coefficients {a, (3) of the decomposition of the projection of {Yj-^,Zl^) are 
shown to solve a regression minimization problem and are expressed in terms of expected 
values. Note that a general regression approach has also been used by Bouchard and 
Touzi for BSDEs in [5]. Finally, the last step consists in replacing the minimization 
problem for the pair (a, /3) in terms of expectations by similar expressions described in 
terms of an average over a sample of size M of the Brownian motions W and B. Then, 
a proper localization is needed to get an L^ bound of the last error term. This requires 
another Picard iteration and the error term due to this Monte Carlo method is described 
in Theorem 15. 8i 

A motivation to study BSDEs is that these equations are widely used in financial models, 
so that having an efficient and fast numerical methods is important. As noted in |12| . 
BDSDEs are connected with stochastic partial differential equations and the discretization 
of (|2.2p is motivated by its link with the following SPDE: 

u{t,x) = (/)(x) + / i£,u{s,x) + f{s,x,u{s,x),'Vu{s,x)a{x))jds 

+ / g {s,x,u{s,x),'Vu{s,x)a{x)) dB s, (1-5) 

Discretizations of SPDEs are mainly based on PDE techniques, such as finite differences 
or finite elements methods. Another approach for special equations is given by particle 
systems. We believe that this paper gives a third way to deal with this problem. As usual, 
the presence of the gradient in the diffusion coefficient is the most difficult part to handle 
when dealing with SPDEs. Only few results are obtained in the classical discretization 
framework when PDE methods are extended to the stochastic case. 

Despite the fact that references [2] and [3] deal with a problem similar to that we 
address in section 3, we have kept the results and proofs of this section. Indeed, on 
one hand we study here an implicit scheme as in [7j and wanted the paper to be self 
contained. Furthermore, because of measurability properties of Iq and Yq, the statements 
and proofs of Theorem 3.6 in [2] and Theorem 4.6 in [3j are unclear and there is a gap in 
the corresponding proofs because of similar measurability issues for (1^) and (Y^^). 

The paper is organized as follows. Section 2 gives the main notations concerning the 
time discretization and the function basis. Section 3 describes the time discretization and 
results similar to those in [2] are proved in a more general framwork. The fourth section 
describes the projection error. Finally section 5 studies the regression technique and the 
corresponding Monte Carlo method. Note that the presence of increments of the Brownian 
motion B, which drives the backward stochastic integrals, requires some new arguments 
such as Lemma 15.161 which is a key ingredient of the last error estimates. As usual C 
denotes a constant which can change from line to line. 



2. Notations 

Let {Wt,t > 0) and {Bt,t > 0) be two mutually independent standard Brownian mo- 
tions. For each a; € M, let {Xt,Yt, Zt,t € [0,r]) denote the solution of the following 
Backward Doubly Stochastic Differential Equation (BDSDE) introduced by E.Pardoux 
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and S.Peng in [12]: 

Xt=x+ [ b (X,) ds+ [ a (Xs) dWs, (2.1) 

Jo Jo 

Yt=^{XT)+ [ f{Xs,Ys,Z,)ds+ [ giXs,Y,)d'Bs- [ Z^dWs- (2.2) 

Jt Jt Jt 

Assumption. We suppose that the coefficients f and g satisfy the following: 

<^{Xt) €L^, 
\f{x,y,z) - f{x',y',z')\ <Lf {\x- x'\^ + \y -y'l"^ + \z - z'f) , (2.3) 

\g{x,y) - g{x',y')\^ <Lg {\x - xf + \y- yf ) , (2.4) 

Note that ()2.3p and ()2.4p yield that / and g have hnear growth in their arguments. We use 
two approximations. We at first discretize in time with a constant time mesh h = T/N, 
which yields the processes (X^,y^,Z^). We then approximate the pair (y^,Z^) by 
some kind of Picard iteration scheme with / steps (Y^'^'^ , Z^'^^ for i = 1, . . . , /. 

In order to be as clear as possible, we introduce below all the definitions used in the 
paper. Most of them are same as in jTj. 

(NO) For < t < i' < T, set Tt = Tf V Tfj. and 

j-w ^^ (-p^^. Q < s < t) V AA, Tf^^, =(y{Bs-Bt>]t<s<t')y N. 

Efc is the conditionnal expectation with respect to Tty, ■ 
(Nl) A^ is the number of steps of the time discretization, the integer I corresponds to the 
number of steps of the Picard iteration, h := T/N is the size of the time mesh and 
fork = 0,1,... ,N wesettk := kh and AB^ = Bt^^^-Bt^, AWk+i = Wt^^^-Wt^. 
Let TT = tQ,ti, . . . ,tN = T denote the corresponding subdivision on [0,T]. 
(N2) The function basis for XF is defined as follows: let au < bk be two reals and 
{Xi)i=i...L denote a partition of [au, bk]; for i = 1, . . . ,L set 



u. (xiT) -.=1^. «) /^P {Xll € Xn (2.5) 

(N3) The function basis for N ~ A/'(0, h) is defined as follows: let a < b two reals and 
{Bi)i=i,,,L denote a partition of [a, b] . For i = I, . . . ,L set 



Vi (N) :=ls, (N) /^/p{nTB~) (2.6) 

(N4) For fixed k = 1, . . . ,N, let p^ denote the following vector whose components belong 
to L^ (0). It is defined blockwise as follows: 

Kra)../-^.w)%^) , L w) .._ (^5._,) ^^] , 

\ / 77V ^ ^ '^Ni'^N — l 



N-1 -^ o 

/ t]v,«JV-l,.--.«fc + l 

where i]\[, . . . , i^+i G {1, . . . , L}. Note that p^ is J^ti^ -measurable and Kp^pl. = Id 
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3. Approximation result: step 1 

We first consider a time discretization of equations (j2.ip and (|2.2p . The forward equation 
s approximated using the Euler scheme: X/j = x and for A; = 0, . . . , A^ — 1, 

Xi^^^ = X^^ + hb{X[l) + a{Xll)AW,+,. (3.1) 

The following result is well know: (see e.g. [5]) 

Theorem 3.1. There exists a constant C such that for every N 



max sup E 

^=l'-'^tfe-i<r-<tfe 



Xr - Xf 



N 
fc-i 



< Ch, max E Ixf 1^ = C < oo. 

k=0,...,N ' '^ ' 



The following time regularity is proved in [2] (see also Theorem 2.3 in [T]), it extends 
the original result of Zhang J13j . 



Lemma 3.2. There exists a constant C such that for every integer N >1, s,t € [0,T], 
^E / (\Zr-Zt^_^\^ + \Zr-ZtJ^)dr<Ch, E\Yt - Ys\^ < C \t - s\ . 

I- 1 -/ 1 1- _ 1 



fc=i 
The backward equation (|2.2p is approximated by backward induction as follows: 

Y,^-.=HXli), Zli:=0, (3.2) 



Zil :=^E, (y/:,,AW^,+ij + -ABA [g [Xil,,Y-^,) AW^.+ij , (3.3) 

yt^ ■■=Wi:,, + hf (Air , y,f , <) + ^^^^IE.5 «^ , y,f^^) , (3.4) 

Note that as in [2], [3] and [7] we have introduced an implicit scheme, thus different from 
that in [1]. However, it differs from that in p] and [3] since the conditional expectation 

we use is taken with respect to Ftf. which is different from a ( Xj , j < /c ) V cr (i?i . , j < A;) 

used in [3]. 

Proposition 3.3 (Existence of the scheme). For sufficiently large N, the above scheme 
has a unique solution. Moreover, for all k = 0, . . . , N, we have YJ^ , Z^ € L? {J't^)- 

The following theorem is the main result of this section. 

Theorem 3.4. There exists a constant C > such that for h small enough 

^-1 rt, 

Ely,. -Yf\' + 

0<k<N 



N-1 „fj,^j 

max E|y,,-y,f|'+ J] / E\Zr-Zllfdr<Ch + CE\cP{X('^)-cP{XT)\\ 



The rest of this section is devoted to the proof of this theorem; it requires several steps. 
First of all, we define a process {Y^ ,Zi)^^iqj,i such that Y^^ and Z^^ are Ft^ measurable, 

and a family of J^t^. measurable random variables Z^' , /c = 0, . . . , A as follows. For t = T, 
set 



Yf := $ (A,^) , Z? := 0, Zf;^ := 0. (3.5) 

Suppose that the scheme {Y-i^,Z^) is defined for all t G [tkiT] and that Z^' has been 
defined for j = N, . . . ,k. Then for h small enough the following equation 

<-i -K^-i {K + f K_., <_,><_,) At.-i + <7 «,1^,:) ^S,_,) (3.6) 
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has a unique solution. 

Using Proposition 13.31 and the Hnear growth of /, we deduce that the map F^ defined by 

F^{Y) = Efc„i (e + hf [X{1_^,Y, Z^^_^)) (3.7) 

is such that F^ [L? {Tt^_^)) C L^ [Tt^_^). Futhermore, given Y,Y' £ L^ (Ttk-i), the L^ 
contraction property of Efc_i and the Lipschitz condition (j2.3p imply E \F^{Y) — F^ iY')\ < 
h'^LfK \Y — Y'\ . Then F^ is a contraction for h small enough and the fixed point theorem 
concludes the proof. 
We can extend M^ to the interval t E [tfc_i,tfc] letting 



Ml^:=E(Y,l + f(x[[_^,M,'^_^,Z^]At,.,+g{xi[,YZ)AB, 



t-. 



^ry:Ft,,T,, 



which is consistent at time t^-i- 

By an extension of the martingale representation theorem (see e.g. J12j p. 212), there exists 



a IT^ V ^^^_ x] -adapted and square integrable process {N^) ^^ ^ , such that 

for any t G [tfe-i,tfc], M^ = M^^_^ + //^_^ N^dWs and hence M^ = M^ - //'= N^dWs- 
Since, 

we deduce that for t G [tfc_i,tfc] 

M^ = Y,l + f [X[[_^ , M,\_^ , Z[[_^) Atk-i + 5 K, Y,l) %Bk-i - f' N^^dW^. (3.8) 
For t G [tfc-i,ifc)) '^6 set 

y,- := M^ Zf := iV,^ Zf;^^ := Ie^.i U *' Z.Mr j . (3.9) 

Lemma 3.5. For all k = 0, . . . ,N, 

Y,l = Y,^, Zf/ = Z[l (3.10) 

and hence for k = 1, . . . ,N 

K-.=K+r f{xt.^K-vZtL)d^+r aixlY.Dd'Br-r z:dWr (3.11) 

Proof. We proceed by backward induction. For k = N, (j3.10p is true by (j3.2p and (j3.5p . 

r,'^ = y,^, z^'^ = z/^. 



Suppose that ([3l0]) holds for / = A^, A^ - 1, . . . , /c, so that F^^ = F^f , Zf;^ = Z/^. Then 
([310]) holds for / = A; - 1; indeed, for ^ := F^f + %Bk-ig {X[[, YJ^) we deduce from ([331) 
and dMj that Af.^, = F^ (m^,), Y.^^ = F^ (y,f_^) and Y,l_^ = Af^. = ^« {K-.)^ 
where F^ is defined by (j3.7p . So using the uniqueness of the fixed point of the map F^ , we 
can conclude that Y^l_^ = Y/^_^{= M^^_J. Therefore, ([33]) and ([33]) imply ([XTT]) . Ito's 
formula yields 

AWk Z^dWr= {Wr-Wt^_^)Z^dWr+ / Z^ dWsdWr + Z^dr, 

J'tk-i Jik-l Jik-i Jik-i J'tk-i 

so that ¥.k-^i(AWkjll_^Z;dWr^ = ¥.k^i (jl^_^ Z; dr\ = hZ^^\. Hence multiplying 

(|3.1ip by AWk and taking conditional expectation with respect to ^jj._i = J^t^_^ ^ ^u_ t- 
We deduce 

hZ^^;\ =E,_i {Yl'^AWu) + "aBu-i^u-i [g {X^,,Yf^) AW^) 
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Comparing this with (j3.3p conchides the proof of (13.10p for I = k — 1. D 

Lemma [3 .51 shows that for r G [tk,ik+i] one can upper estimate the L^ norm of Zr — Z^ 
by that of Z^ — Z^ and increments of Z . Indeed, using (j3.10p we have for A; = 0, . . . , A^ — 1 

and r £ [tk,tk+i] 



ElZr-Z^j"^ =E 



77,1 



^r — Z^^ 



< 2E\Zr - Zt,y + 2E 



ttA 



Zt, - z. 



Furthermore, (j3.9p and Cauchy-Schwarz's inequahty yield for k = 0, . . . ,N — 1 

2 1 ftk+i 



E 



7r,l 



Zf, — z+ 



<-E 
h 



\Zt,-Z^\Ur 



tk 



■fe+i 



<-E / "^ \Zu - Zr?' dr + -E 



ti. 



k + l 



\Zr-Z^?dr. 



Hence we deduce 



fc=0 



N~l 



k=0 



■k + l 



N-l 



'k + l 



N-1 ^tfc+1 

^ / E \Zr - Z^ll'^dr <6Y1 I "'^\Zr-Ztj'^dr + AYl I ' ^\Zr - Z^^? dr. 



tk 



k=0 



tk 



(3.12) 



Using Lemma 13.21 and (|3.12p we see that Theorem 13.41 is a straightforward consequence of 
the foUowing: 

Theorem 3.6. There exists a constant C such that for h small enough, 

max E \Yu - >"tT|^ + / E \Zr - ZI!? dr<Ch + CE\^ (X^) - $ (Xt)? ■ 
Proof. For any k = 1, . . . ,N set 



4-1 := E 



Ytk-i - Ytl 



tk 
+ E / \Zr- Z';?dr. 



(3.13) 



Since Ytf__^ — ^t^_j is J-ij._-^-measurable while for r G [tk,tk+i] the random variable 
Zr — Zr is T^ V J^^ _ /^-measurable, we deduce that Yty._^ — Ytl_^ is orthogonal to 
Jl^_^ {Zr - Z^) dWr. Therefore, the identities ^^ and (fSHT) imply that 

2 



4-1 =E 



=E 



Ytk-i- Y^. 



ftk 
Jtk-i 



[Zr - Z;) dWr 



tk 



ytk-ytl+ (^ [f{Xr,Yr,Zr)-f{Xil_^,Yl_^,Z^;t,))dr 

2 

{g{Xr,Yr)-g{X^^,Yl))d'B, 

Notice that for tk-i < r < tk the random variable g {Xr,Yr) — g (X/^, y^^) is T^ V J-'^j^- 

measurable. Hence Yi^.— y^^, which is J^tfe -measurable, and f^ '' [g {Xr,Yr) — g {X^, yj^)) dB 

are orthogonal. The inequality (a + 6 + c)^ < (l + j) (a^ + c^) + (1 + 2A) 6^ + 2oc vahd 
for A > 0, Cauchy-Schwarz's inequality and the isometry of backward stochastic integrals 



•(— 
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yield for X := j- , e > 0: 



4-1 < ( 1 + - 



E\Yt^-Y,Z\ +E 



+ (l + 2-)E 



r {g{Xr,Yr)-g{xi[,Y,l))d'Br 



h 

<(1 + - 



E\Yk-Ytl\^ + E \g{Xr,Yr)-g{X,^^,Y,l)\ dr 



tfc-i 



+ {h + 2e)E T' \f {Xr,Yr,Zr) - f (X^^_^,YI_^,Z^;\ 

J^k-l 



dr. 



The Lipschitz properties (j2.3p and (j2.4p of / and <? imply 



4-1 < I 1 + - 



I ''fc tfc I y 



(/i + 2e) L/E 



-AT 



tfc 
tfc-1 

2 



X,-X^^\^ + \Yr-Yl\^)dr 



Xr — X^ 



+ 



Yr - Yl 



+ 



Zir — Z- 



7r,l 



dr. (3.14) 



Using the definition of Zl' in (|3.9p . the 1? contraction property of E^ and Cauchy- 
Schwarz's inequality, we have 



/lE 



7r,l 



^t, - z: 



2 1 

< -E 
h 



E 



tfc+i 



k I ; v-ife 

tfc 



{Zt, - z;) dr 



< E 



tfe+i 



|Zt, -z;rdr. 



tfc 



Thus, by Young's inequality, we deduce for A; = 1, . . . , A^ 



E 



tfc 



tfc-i 



iir. — Z, 



7r,l 



^ dr<2E r \Zr- Zt,_,\^dr + 2/iE Zt,_^ - Zf;\ ^ 

"'ifc-l 

<2E f ' \Zr - Zt,_,f dr + 4E f ' \Z^ - Zr\^ dr 
•'tfc-i •'tfc-i 



+ 4E 



|Zr-Zjj^_J dr 



<6E 



/' \Zr - Zt^_^\^ dr + AE r \Z^-Zr\^dr. 

Jik-l Jik-l 



We now deal with increments of Y . Using Lemma 13.21 we have 



E 



tfc 



tfc-i 



Yr - YI" 
^ tfc-1 



tfc 



tfc 



dr<2E/ \Yr-Yt,_,Xdr^2E\ Yt^_^-Y^l_^ 

•'tfc-i ■Jtk-l 

<Ch^ + 2/iE Yt, , -YZ , 



dr 



while a similar argument yields 



E / \Yr - y/ dr <Ch^ + 2hE \Yu - Y^'V . 
I I ' j^fc I — I '•fc tfc I 

'tfe-i 
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Using Theorem 13.11 and the previous upper estimates in (I3.14P , we deduce 



4-1 < ( 1 + ^ ) E \Yt, -Ytl\^ + Lf{h + 2e) 



Ch^ + 2/iE 



^tk-i ^Z-i 



+ 6e/"' \Zr - Zt^_^f dr + 4E f '' \Z; - Zr\^ dr 

Jik-l Jtk-l 



+ LAI 



h 



\ 1^ ''k 



Thus, (|3.13p implies that for any e > 

2 r^k 

[l-2Lf{h + 2e)h]EYt^^-Ytl_^ + [I - ALj {h + 2e)]E \Zr-Z^\^dr 

<{l + -^+2Lg(l + -^ h\ E \Yt, - Yl\^ + (hf {h + 2e) + Lg{l + -\\ Ch^ 



QLf{h + 2e)E \Zr - Zt^_^ \ dr. 



Now we choose e such that 8eLj = i^. Then we have for C = 4Lj, h smah enough and 
some positive constant C depending on Lf and Lg-. 



1-C/iJE 



'^tfc-i '^tLi 



+ ( --Ch\E r \Zr-Z;\^dr 

^k — 1 

^k 



r'^k 
< {1 + Ch)E\Yt, - Ytll'^ + Ch'^ + CK / \Zr-Zt,_,fdr 



(3.15) 



We need the following 

Lemma 3.7. Let L > 0; then for h* small enough (more precisely Lh* < 1) there exists 
r := i_j^^* > such that for all h G (0, h*) we have jzrjji < 1 + F/i 

Proof. Let /i G (0, /i*); then we have I - Lh > I - Lh* > 0. Hence j^^ < i^xTF ^ ^■' ^° 
that Lh < Th{l - Lh), which yields 1 + Th- Lh- TLh^ = (1 + r/i)(l - Lh) > 1. This 
concludes the proof. D 



Lemma 13.71 and (j3.15p imply the existence of a constant C > such that for h small 
enough and k = 1,2, ... ,N we have 



E 



^.-1 - yti 



<{l + Ch)E\Yt,-Ytl\+Ch^ + CE \Zr - Zt^_^\ dr. (3.16) 



The final step relies on the following discrete version of Gronwall's lemma (see [7]). 

Lemma 3.8 (Gronwall's Lemma). Let (fl/t), (bk), (c/.) be nonnegative sequences such that 
for some K > we have for all k = 1, . . . ,N — 1, ak-i + Ck-i < {1 + Kh)ak + 6fc_i. Then, 

forallk = 0,...,N-l,ak + ZZf <^i < e^^^"*^') (a^ + ZZf ^i 
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Use LemmaESlwith Cfc = 0, a^^i =E Yu , - Y.'' , and bk = CE f^" \Zr - Zt, , I + 
C/i^; this yields 



AT 



sup E\Yt,-Ytl\'<C\E\YT-Ytl\' + S2E \Zr - Zt, ,\' dr + Ch 

0<k<N \ '■ 



fc=l 



tk 



tk-i 



<C{¥.\YT-YtlY + Ch], 



(3.17) 



where the last upper estimate is deduced from Lemma |3.2[ We sum ()3.15p from k = 1 to 
k = N; using (|3.17p we deduce that for some constant C depending on Lf and Lg we have 



Ch]E 



(■T _ N-i _ _ 

/ \Zr- Z^\^ dr <Ch V E \Yt^ - Ytl\^ + Ch + CM \Yt - >"*; |^ 
■^0 k=l 

<Ch + CE \Yt - y^ f + Ch{c + iVE \Yt -Y^^\^ 
<Ch + CE\YT -Y^^\^ . 

The definitions of Yt and 1^^ from (j2.2p and (j3.2p conclude the proof of Theorem I3.6i D 



4. Approximation results: step 2 



In order to approximate {Y^^ , Z{^) we use the idea of E.Gobet, J. P. Lemor and 

X.Warin [7], that is a projection on the function basis and a Picard iteration scheme. In this 
section, N and / are fixed positive integers. We define the sequences ( Y^ 



rN,i,I 



i=0,...,I k=0,...,N 



and I Z 



7NJ 



k=0,...,N-l 



using backward induction on k, and for fixed k forward induction on 



^NJ 



N,iJ 



i for Y^^'"'^ as follows: For k = N, Z^/ = and for i = 0, . . . , /, set Y^^'"'^ := Pn<^ (X/^) . 



Assume that Y, ' ' has been defined and set 



Z 



NJ 



-t/'^ 



rNJJ 



Y,Z'-^nUi 



n^' 



'N 



NJJ 



AB,5 X4V,y-- AH^,+i 



(4.1) 



Let Y,^ 
scheme: 



N,0,I 



and for i = 1, . . . ,/ define inductively by the following Picard iteration 






N ^^N,i-lJ ryN,I 



f[K^K 



^K 



+ Pk 



^Bks{x-^,,Y,Z')], (4.2) 



where Pk is the orthogonal projection on the Hilbert space Vk C L^ {Ft^ ) generated by the 
function p^ defined by (N4). Set R^ := I — Pk- Note that Pk is a contraction of L^ i^tk)- 
Furthermore, given Y (i L? (^2), 



EkPkY = Pk^kY = PkY. 



(4.3) 



Indeed, since Vk C L'^{Ttk), ^kPkY = PkY. Let Y £ L'^; for every, Uk £ Vk, since Uk 
is Ji^ -measurable, we have K{UkRkY) = = E (C/fcEfci?fcy); so that, PkEkRk{Y) = 0. 
Futhermore Y = PkY + RkY implies PfcEfcY = PkPkY + Pk^kRkY = PkY which yields 
(|4.3p . Now we state the main result of this section. 
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Theorem 4.1. For h small enough, we have 

N-l 



N-1 



max E 

0<k<N 



^N,I,I _ ^N 



+ ^E^<''-^ir <Ch''-' + C^E\R,Y, 



Ar|2 
tfe I 



k=0 



fc=0 



N~l 



+ CE\^{x['^)-PN^{xg)\ +ChJ2^\RkZ, 



zN,I 



fc=0 



Proof of Theorem 14. IL The proof will be deduced from severals lemmas. The first 
result gives integrability properties of the scheme defined by ()4.ip and ()4.2p . 

Lemma 4.2. For every k = 0, . . . ,N and i = 0, . . . , / we have Y^ '*' , Z^ ' G L^ {Ttk ) • 

Proof. We prove this by backward induction on k, and for fixed k by forward induction on 
i. By definition Y^^'^' = Pj\i^{Xl^) and Z^^ = 0. Suppose that Z^.' and Y^,' ' belong 
to L^ {J't) for j = N,N — 1, . . . ,k + 1 and any /, and for j = k and / = 0, . . . , i — 1; we 
will show that Y^ 



N,i,I ryN,I 



zZ''^i^'{J^tk). 



The measurability is obvious since Vk C L (J-'k)- We at first prove the square integrability 



zNJ 



of Z^ ' . Using (j4.3p . the conditional Cauchy-Schwarz inequality and the independence of 
Al^fc_i_i and J'tk i '^s deduce 



E 



P, {Y,^;[''AWk^, 



=E 



PkE,. ( Y^'^:^AWk+i 



■k^k\^t,+, 



< E 



E. Y 



k\^t 



k + 



^AWk+i) 



<E EfclAVFfc+il'Efc 



NJ,I 

■fe+i 



< /lE 



Y 



N,I,I 



tfc+i 



<r- _ 



A similar computation using the independence of AW^+i and J-j^,, and of Ai?^ and J^t^+i 
as well as the growth condition deduced from (12. 4p yields 



E 

<E 

<h'^K 



/<r- _ 



EkCKB,AW,^^g(xf[^^,Y,^l[' 



E 



PkEk (ABkAWk+ig W+,,>^C, 



< ft,EEfc+i 



rNJJ 



ABkg X' X" 



Af,/,/ 
2 



9 (^*l,'<;f ) f < 2/^' b(0,0)|^ + 2/^2L, (e 






+ E 



r. 



Af,/,/ 



zNJ 



The two previous upper estimates and the induction hypothesis proves that Z^ ' E 
L^ (J'tk)- A similar easier proof shows that 1^, '*' E L^ i-^t,,)- D 

The following lemma gives L^ bounds for multiplication by AW^+i 
Lemma 4.3. For every Y e L'^ we have E\Ek {YAWk+i)f < h (^Elyp - E|EfcF|^ 
Proof. Using the fact that E^ (AWk+iEkY) = we have 

E \Ek {YAWk+i)\^ =E \Ek {{Y - E,.y) AWk+i)\^ 
Using the conditional Cauchy-Schwarz inequality and the independence of AWk+i and J"t^ , 
we deduce E\Ek{YAWk+i)\^ < hE\Y-EkY\^ < h (e\Y\'^ -E\EkY\^] ; this concludes 
the proof. 

The following result gives orthogonality properties of several projections. 
Lemma 4.4. Let k = 0, . . . ,N — 1, and Mtf.^-^,Nt^._^_^ G L"^ [Ttk+i) ■ Then 

E(PkMt,^^pJ'ABkNt^^\)=0. 



D 
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Proof. Let Mt^^-^ G L^ (-^tfc+i); the definition of Pk yields 



AT-l 

fc<Z<Ar-ll<ijv,.--,«!+i<i r=/+l 



jVN Ai?Af-l 



"KBi 



(4.4) 



where a{iN) = E [M^.^^n,^ (X,^)] , a (TV - 1, i^v) = E 



M.,,,^.. (X,^) ^^ 



and 



V- 



AB, 



. Taking conditional ex- 



a (/, i;v, . . . , i^+i) = E [Mt,,,,^,^ (X,^) n.=I+i ^v ( Ai?.y ^^ 

pectation with respect to J^t,,+^ ■, we deduce that for any i^v, • • • , «fc £ {Ij • • • ) ^} 

7V-1 



a{k,iN,--- ,ik+i) =E 



^*.+i«i^W) n v„.[ABr)Ek+,-^ 



ABk 



r=k+l 



0. 



A similar decomposition of Pk I ABkNf J yields 



V 



Y niN)u,,{X^)+ Y P{N-l,iN)u,^{X^ 



N-] 



AB 



N-l 



Vh 



Pk yABkNt^^^j — ^ f^ yoiM J L^i^ yy^^^j -r ^ p ^1, - J., .jv; "-Jjv V^'-tfe, 
\<iiq<L l<ii^<L 

+ E E (3{l,iN,...,ii+i)n,,{Xll) llv.^^'ABr)^ (4.5) 



A 5/ 



r=l+l 



rv 



where /3(i^)=E ASfcA^i.^^Ui^ (X/^) , /? (A^ - l,i;v) = E 



ABkNt^^^u,^ {X[[) 



N\ ABjv_i 



In the above 



and f3{lM,...,H+i) = ^[ABkNt^^^Ui^ {Xl'JUr=lllV^r [^Br) ^ 

sum, all terms except those corresponding to I = k are equal to 0. Indeed, let / € 

{k + 1, . . . ,N — 1}; then using again the conditional expectation with respect to J~t,^+i we 

obtain 

N-l 



(3{l,iN,---,ii+i) =E 



^B, 



Nt.^^u,, {X[[) H v,^ (tBr) -^Ek+i'ABk 



r=l+l 







<-- 



The two first terms in the decomposition of Pk I AS^Afj.^^ J are dealt with by a similar 

argument. Notice that for any I £ {k + 1, . . . , N — 1} and any ij\[, . . . , ii,JN, ■ ■ ■ ,jk+i G 
{1, . . . , L} we have, (conditioning with respect to J^t,,)'- 

N-l tr^ A^-i 

Ui 



E 



^JJV 



iv-i AD iv-i An 

xrj n ". (Sb,) ^»„ (x«) n "> (Sb,.) ^ 

r=/+l r=fc+l 



A similar computation proves that for any iat, j'at, . . . ,jk+i G{1,...,L},^G<1, — ^r-- 

N-l 



0. 



ABjv_i 



E n,, (X,^) Cn,-, (X,^) n ^"r[AB, 

r=k+l 

The decompositions ()4.4p and ()4.5p conclude the proof. 



0. 



D 



AT,/ 



,A,/ ^N 



The next lemma provides upper bounds of the L -norm of Z^ ' and Z^ ' — Zj- . 
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Lemma 4.5. For small h enough and for k = 0, . . . , N—l, we have the following Lp' hounds 



E 



zi 



NJ 



%'^ 



Y, 



NJJ 

fc+i 



E 






n'^ 



^B,9 (<,, , <;('^) f - E |e, (AB,g (<^^ , Y, 



.N,I,I 

k + l 



(4.6) 



E 



ryN,I 


yN 


' <E RkZ^^ 


2 1 


(. 


^tk+i ^tk+i 


2 


E 




VN 




4(^ 


^i?. 






2 






-E 


/■f- 


^Sfc 




- , 


^{^n.^y^l.)] 


) 



(4.7) 



Proof. Lemma 14.41 implies that both terms in the right hand side of ()4.ip are orthogonal. 
Hence squaring both sides of equation (j4.ip , using (j4.3p and Lemma 14.31 we deduce 



E 



Z't 



NJ 



-J?^ 



rNJJ 



F, F-';'A».,„ 



^F'^ 



-N 



NJJ 



P,iAB,giXtl^,Y,^:-- AW,^, 



"/l2 



E 



4"^ 
4'^ 






.N,I,I 



i-crAWt+i 



^ft^*^ 



/V- 



TV,/,/ 



PfeEfc Ai?fc5 X4^^^ , y,;:;;-^ AWk+1 



Yf''/AW,^^ 



Y 



N,I,I 



tfc+i 
2 



+ /?^ 



EJAi?,,(<^^,y,f;f)AI^,+i 



E 



KkY, 



N,I,I 

k+l 



+ k^'^ 



'^^ \ tfc + 1' Ifc + 1 



E 



EJ'AB,g(x-^^,Y-;['' 



this proves (|4.6p . 

Using the orthogonal decomposition Z/^ = Pk^ll + RkZ[^^, since Z^^^''' G "P^ we have 



E 



yNJ _ yN 
tfe 



yN 



E 



7^^,^ p yN 



+ ^\RkZ^\ ■ Futhermore ^^, (jH]) and (gSD yield 



yN,I 
'tk 



N 



PkZt, 



h 



-Pi- 



yZt'-<^^^^- 



h 



ABJgiX^ 



rN yN,!,! 



9 X, 



N 

tk+i ' "" ifc+i 



Y^.^]]AWk+i 
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Lemma 14.41 shows that the above decomposition is orthogonal; thus using (14. Sh . the con- 
traction property of Pk and Lemma |4.3| we deduce 



E 



tfe '*' tfe 



h^ 



E 



PA 



^h^ 



Pk&k 






^i?, Aiy.,, , <, , <;('0 - , <, , y- , 



4^ 



E. 



-NJJ 



N 



1-- - 1^^ J AW.+, 



+ > 



Efc 



%B,^w,,, U «,y,f;('0 -.«.,<. 



4'^ 



ifc-n ifc+i 



'■fc+i 



E 



E.(«'-C)f) 



+ ;;'•= 






-N 



NJJ 









ABfc 

-E|Efc(XSfc 
This concludes the proof of (14. 7p . 

For y e L2 (J;J, let xf'^(i^) be defined by: 



D 



V. 



The growth conditions of / and g deduced from (j2.3p , (j2.4p and the orthogonality of A i?fc 
and J^tj.+i imply that Xk ' (-^^ (-^ifc)) C Vk C L'^ (-^tfc)- Futhermore, ()2.3p implies that for 

yi,y2Gi^M-^iJ 



E 



AT,// 



NJ 



xriY2)-xr'iYi) <Lfh'E\Y2-Y,\ 



(4.8) 



and (J12D shows that Fjf '''^ = Xk'^ (^if ''^^'0 for z = 1, . . . , /. 

Lemma 4.6. For small h (i.e., h^Lj < 1) and for k = 0, . . . ,N — 1, there exists a unique 
Yjf'°°'^G L^{Tt,) such that 



y,f '-'^ = P, 



Cf + ^f «^ <'°°'^ <'0 + ^^^^ «. ' C!" 



E 



-yAf,oo,/ _ yA,i,/ 

tk tk 



< L}h^'E 



y 



Af,oo,/ 



*fe 



and t/iere exists some constant K > such that for every N, k, I, 



(4.9) 
(4.10) 



E 



y 



Af,oo,/ 



<Kh+{l + Kh)E 



y 



N,I,I 

fe+i 



NJ 



(4.11) 



Proof. The fixed point theorem applied to the map Xk ' i which is a contration for /i L/- < 
1, proves ()4.9p ; ()4.10p is straightforward consequence from ()4.2p by induction on i. Lemma 



shows that -Pfc^, ' ' and P^ I AB^g [Xf^ i^, ' ' ) ) are orthogonal. Hence for any 



e > 0, using Young's inequality, (|4.3p . the L contracting property of P^, the growth 
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15 



E 



Y, 



N,oo,I 



^< ( 1 + ^ IE 



h 



PkYf'''' 



+ {h^ + 2e/i)E 



Pk 






+ ( 1 + - IE 



Pi. 






< ( 1 + - IE 



E^y,^'^'^ 
"^ tfe+i 



+ 2(/i2 + 2e/i) 1/(0,0, 



+ 2L/-(/i^ + 2e/i) E|X/; 



^7V|2 



+ ( 1 + - IE 



E. 



E 



Yt 



N,ooJ 



rNJJ 






+ E 

2 



Z, 



NJ 



Using the upper estimate (j4.6p in Lemma 14.51 we obtain 

2 



[l-2L/(/i^ + 2e/i)]E y^ 



7V,oo,/ 



/l 



< 1 + - - 2L/ (/i + 2e) E Efcy;';'/ + 2 (/i2 + e/i) M/(0, 0, 0)^ + L/E |X/ 



tfel 



+ 2L/ (/i + 2e) E 



y 



AT,/,/ 

^k + 1 



+ 2Lf{h + 2e)¥. ABkg[Xil^X:i\ 



-N 



rNJJ 



V. 



rNJJ 



+ i^l + --2Lf{h + 2e)j E Efc ^Ai?fc<7 (X4\,,yi;:;t 

Choose e such that 4L/e = 1. Then (l + |) - 2% (/i + 2e) = 2L//i and 2L/(/i + 2e) 
2Lj-/i + 1. Using Theorem 13.11 we deduce the exitence of C > such that. 



[l-2Lf{h'^ + 2eh)]E 



y 



7V,oo,/ 



tfc 



<Ch + {l + ALfh) 



E 



y 



N,I,I 



+ E 



V- 



7V 



rN,I,I 



^Bk9(xi:^,x:;^ 



Then for /i* S (0, 1] smah enough (ie (2Lj + l)/i* < 1), using Lemma \37l\ we deduce that 
for r := i_(2L +i)h* ^^'^ ^ ^ (0,/i*), we have (1 — {2Lf + l)h)~^ < 1 + Th. Thus using the 

independence of AB^ and J^tk+n the growth condition (12. 4p and Lemma l3.lt we deduce 
the existence of a constant C > 0, such that for h £ (0, /i*). 



E 



y 



A,oo,7 



<Ch + {l + Ch)E 
<Ch + {l + Ch)E 
This concludes the proof of (14. lip . 



yN,i,i 
yN,iJ 



+ C/iE 






D 



Let r?^ 



E 






for /c = 0, . . . , A^; the following lemma gives an upper 



bound of the L^-norm of Yf '°°' — PuY^ in terms of f]^'^. 
Lemma 4.7. For small h and for k = 0, . . . ,N — 1 we have: 



E 



rN,00,I 
"tk 






N,I 



< (1 + Kh)r,',^^\ + Kh 



rN\2 



E|i?fey/;| +E\RkZt^ 



iV|2' 
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Proof. The argument, which is similar to that in the proof of Lemmas 14.51 and 14.61 is more 
briefly sketched. Applying the operator P^ to both sides of equation ()3.4p and using ()4.3p . 
we obtain 



NJJ 



Hence Lemma 14.61 implies that 



yN^OOj _ p^yN ^p^ 



'tfe 



kH, 



yN,!,! _ yN 



"tk^ 



"-fe+l 



+ hPk 



f vN vN,oo,l yN,l\ f I vN vN ryN\ 



+ p, (^i?, [, «„ y,^tO - K<- <^ 



Lemma [4. 41 proves the orthogonality of the first and third term of the above decomposition. 
Squaring this equation, using Young's inequality and (|4.3p . the L^-contraction property 
of Pk and the Lipschitz property of g given in (12. 4p , computations similar to that made in 
the proof of Lemma 14.61 yield 



E 



yN,00,I _ pyN 



1 + ^)E 



Pt 



yNJJ _ yN 



+ h^ (l + 2^]E 



Pk 






+ ( 1 + - IE 



i- _ 



Pk ABk 



^N 



-NJJ 






-N -iaAT 



9 (^tk+i^Ytkl,' } - 9 (^tfe+i'^tfe+i 



< I 1 + - IE 



E, 



NJJ 



tfc+i 



Y, 



N 



ifc+i 



+ Lf{h + 2e)h[E 



■^N,ooJ ^N 



+ E 



Zf -^ - Z/^ 



+ ( 1 + - )E 



EjXi.. , <,y-// -, x-,,y-, 



(4.12) 



By construction Y^ '°°' G Vk- Hence 



E 



^rN,oaJ ^N 



E 



YtT' - Pk^U 



+ IE Pfey/: 



Af|2 



tfe 



Using Lemma 14.51 we deduce that for any e > 
(l-P/(/i2 + 2e/i))E 



rN,OOj 



y.V.O.,. _ p^y^ 



NJ 



<Lf {h + 2e) r/^Yi + /i^/ (h + 2e) 



1 + - ) - L/ (/i + 2e) ) E 



^Pfc 



-AT] 



N\ 



E Pfcy/' +E PfcZ, 
I '^ tfe I I '^ tfe 



Efc ( y^^'^'^ - y 



,.,. _ yA 

fc+i *fe+i 



+ P/(/i + 2e)E 



-Af 



-A,/,/ 



5 X/^ ,Y;''''']-g{X' ,Y/' 



-A vN 



(4.13) 



-A,/,/ 



Let e > satisfy 2Lf€ = 1; then (l + |) - Lj {h + 2e) = Lfh and P/ (/i + 2e) = P//i + 1. 
Thus, since E^ contracts the P^-norm, we deduce 

(l-P/(/i2 + 2e/i))E 



rN,OOj 






NJ 



<{l + 2Lfh)7^i:^\ + h{l + Lfh) 
+ (l + 2P//i)E 



.Ar|2 



E|P,.y-| +E|P,Z,^ 



A|2 



%Bk 



j^N yNJJ 
tfe+1 ' ife+1 



9 \^tk+l^^tk+i 



REGRESSION MONTE-CARLO FOR BDSDE 
Lf+1 



17 



Let h* € (0, jj^^) and set T = i_(^^~\\sf^t ■ Lemma [3771 shows that for h G (0, h*) we have 

(l — Lf {h? + 2e/i)) < 1 + r/i. The previous inequahty, the independence of Ai?fc and 
J-fj, and the Lipschitz property (j2.4p imply that for some constant K which can change 
for one hne to the next 

2 



E 



yNooJ _ p^y^ 



■^^H 



< (1 + i^/i)??K + Kh 



-Af|2 



I '^ tfe I I '<^ tfe 



iV|2 



+ is:/iE 



<(1 + i^/i)r/f4 + K/i [e \RkY!l\^ + E |i?fcZi^ 
This conchides the proof of Lemma 14.71 



D 



The following Lemma provides L^-bounds of 1^ ' ' , 1^ '°°' and Z^ ' independent of 
N and /. 



Lemma 4.8. There exists a constant K such that for large N and for every I >1, 



max E 
0<k<N 



Y, 



NJJ 



tk 



+ max E 

0<fc<Ar-l 



Yt 



N,ooJ 



+ max /lE 
0<fc<7V 



zi 



NJ 



< K. 



Proof. Using inequality (j4.10p and Young's inequality, we have the following bound, for 
i = l,...,/, /i<l and some constant K depending on Lf. 



E 



Yt 



NAJ 



^<fl + i IE 



1 



t-k tfe 



+ (1 + /i)E 



Y, 



N,oo.I 



tk 



< ( 1 + f 1 Vfh^'E 



Y 



N,ooJ 



tk 



+ (1 + h)E 



Y 



N,oo,I 



tk 



< {l + Kh)E 



Y 



N.ooJ 



tk 



(4.14) 
Choosing i = I and using ()4.1ip we deduce that for some constant K which can change 



from line to line, E 

2 



^tk 



< Kh+ {1 + Kh)E 



Y, 



N,I,I 

^k + l 



Hence Lemma 



yields 



maxfcE 



Y, 



NJJ 



< K. Plugging this relation into inequality (j4.1ip proves that 



maxE 

k 



Y, 



N,I,I 



+ maxE 

k 



Y, 



N,oo,I 



< K <oo. 



Using ()4.6p and the independence of ABk and J^tk+i^ ^^ deduce 



/lE 



7^,1 
'tk 



<E 
<E 



Y 



NJJ 



Y 



N,I,I 



+ E 



N 



rNJJ 



"^ V tfe+1 ' tfe+1 



+ /iE 



^ \ tfe+1 ' tfe+1 



Finally, the Lipschitz property ()2.4p yields 



hM 



7N,I 



<E 



Y, 



N,I,I 

tfe+1 



<{l + 2hLg)E 



+ 2h\g{0,0)\^ + 2hLg (E 

2 



X 



N 
tk+i 



+ E 



y 



N,I,I 

tfe+1 



yN,i,i 

tfe+1 



+ 2h\g{0,0)\^ + 2hLgE 



Xf 
tfe+1 



Theorem 13.11 and the L^-upper estimates of Y^ ' ' conclude the proof. 



D 



N,I 

Vk 



The following lemma provides a backward recursive upper estimate of 77 ' Recall that 

2 



E 



yN,i,i y^ 

^tk ^tk 
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Lemma 4.9. For < k < N, we have: 



Vk'^ < (1 + Kh)rif^^[ + Cfi''-^ + KE |i?feyif P + KhE \RkZl 



In 
Let A;G{0,...,A^— 1}; using inequality (j4.10p and Young's inequality, we obtain 



Proof. For k = N, Y,^ = <l> (X,^) and Vf/'' = P^$ (X,^) so that v^'' = E |<I> (X,^) - Pr,<l> {X,^ 



N\\'2 






^N,I,I ^N 



< [ 1 + - IE 



yNJJ _ yAT.OO,/ 
tk tk 



+ (l + /i)E 



yAr,cx),/ _ yN 
tk *fc 



< ( 1 + - ) L^fh^^E 



Y, 



A,oo,7 



+ (l + /l)E 



T^A,oo,7 p T^Af 



+ (1 + /i)E LR^y/: 



Af|2 



Finally, Lemmas 14.81 and 14.71 imply that for some constant K we have for every N any 
k = l,...,N: 



7?f '^ <Kh''-^ + (1 + /i)E y,f '°°'^ - PkY^^ 



+ {l + h)E\RkY/'J 
<(1 + i^/i)7/fc!;'i + Kh''^' + KE \RkY/;! f + KhE \RkZl[f ; 

this concludes the proof. 



(4.15) 



D 



Gronwall's Lemma 13.81 and Lemma 14.91 prove the existence of C such that for h small 
enough 



A-l 



7V-1 



max E 

0<fc<A 



fc=o fc=o 



y/^'I'I _ Y^^ <Ch^^-^ + C J] E I i^^y.f \+Ch^E\RkZi 

fc=0 

+ CE\<^{xg)-PN<^{xl 
which is part of Theorem 14.11 Let C^ := /iX]/-=o ^ 



N,I 

k 



(4.16) 



Zf '' - Zf 



In order to conclude 



the proof Theorem 14. 11 we need to upper estimate (^^ , which is done in the next lemma. 
Lemma 4.10. There exits a constant C such that for h small enough and every / > 1 

Af-l AT-l 

C^ < Ch^'^^ + ChJ2^ \RkZ^f + C 5^ E {RkYk^'f + C max_ r?f •^. 



A;=0 



k=0 



f- - 



Proof Multiply inequality ()4.7p by h, use the independence of AB^ and J^t^+i s^nd the 
Lipschitz property (j2.4p : this yields 



AT-l 



A-l 



C^ <hJ2^\RkZ[l\' +Y, (i^ + Lgh)^ 



k=0 



k=0 



yN,!,! _ yN 



E 



E. Y 



rN,I,I T^N 



M^t.+i 



Y 



tfe+i 



(4.17) 
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Multiply inequality (|4.12|) by (1 + Lgh){l + h), use the independence of AB^ and J^t^+i 
and the Lipschitz property (j2.4p : this yields for e > 0: 



{1 + Lgh){l + h)E 



h 



yN,O0,I _ p^y^ 



■^^.f 



NJJ 



<! + -(! + Lgh){i + /i)E Efc y,;;;'^ - Y^l^ 



+ Lf{h + 2e) /i(l + Lg/i)(l + /i) E 






+ E 






+ ( 1 + - ) {l+Lgh){l+h)LghE 



■s^N,I,I _ ^N 



(4.18) 



Multiply inequality (j4.15p by {1 + Lgh) and use (|4.18p : this yields for some constants K, 
C, C and he (0,1], e> 0: 



Afc+i:=(l + Lg/i)E 



yN,!,! _ yN 



i^k + 1 



tfe + 1 



E 






+ KE li^fc^tf f + ( ( 1 + ^ ) (1 + Lgh){l + /i) - 1 ) E 



Ea 



i; 



NJJ yN 



tfe + 1 



ife+1 



+ C(/i + 2e)/i E 






E 



Zf ^ - Zf 



+ ( 1 + - 1 ChE 



yNJJ _ yN 

tfc+1 *fc+l 



Now we choose e such that 2Ce = j; then we have for some constant K and /i G (0, 1]: 



Afc+i <Kh'^^^^ + KE li^fcyi^l^ + K/iE 



yNJJ _ yN 



T^k + l 



+ [Ch + -\h[E 



T^N,ooJ ^N 



+ E 



Zf '^ - Zf 



Thus, for /i small enough (so that Ch <\), summing over k we obtain 



Af-l 



fc=0 



J]((l + L,/i)E 



yAf,/,/ _ yN 

tt+1 ifc+1 



"^fc+i 



E 



'^ V tfc+i tfe+i 



7V-1 



<K/i2^-2^ir^E|i2fcy4f| +Kmaxrj^ 



NJ 



k=0 



Af-l 



^^''E E 



fc=0 



Plugging this inequality in ()4.17p yields 



A-l 



yN,<X>J _ yN 



A-l 



+ E 



Z^'' - Zf 
tk ffc 



ic^ <Kh'^-' + hY,E \R,Zllf + i^ E E \R>^<f + ^ 
fc=( 

1 ^"^ I 



NJ 
max 77. 



k=0 



rN,00j _ yN 



k=0 
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Using (j4.13p and Lemma 14.71 we obtain for some constant K and every h S (0, 1] 

N-l N-l N-1 

k=0 k=0 k=0 

N-l N-l N-l 

+ hY,^ \RkYt^\' < i^maxr/f '^ + i^ J^ E \RkY,^f + K/i J] E |i?,,Zi^|' . 

fc=0 A:=0 fc=0 

This concludes the proof of Lemma 14.101 D 

Theorem 14.11 is a straightforward consequence of inequaUty (I4.16P and Lemma 14.101 

5. Approximation step 3 

In this section we will use regression approximations and introduce some minimization 
problem for a M-sample of {B, W) denoted by {B^"", W^, m = 1, . . . , M). This provides a 
Monte Carlo approximation of Y ,1, 1 and Z ,1 on the time grid. 

5.1. Some more notations for the projection. We at first introduce some notations 
(N5) For fixed k = 1, . . . ,N and m = 1, . . . , M , let p™ denote the orthonormal family 

of L^ (Q.) similar to pj. in (N4) replacing X^ by X^'"^ and B by B"^. 
(N6) For a real nxn symmetric matrix A, \\A\\ is the maximum of the absolute value of 

its eigenvalues and \\A\\f = ( Xli j -^ j ) ^^-^ Frobenius norm. If A : W^ — )• M"' also 
denotes the linear operator whose matrix in the canonical basis is A, then \\A\\ is 
the operator-norm of A when M" is endowed with the Euclidian norm. Note that 
\\A\\ < \\A\\f follows from Schwarz's inequality. 
(N7) For k = 0, . . . ,N — 1 and m = 1, . . . ,M let v^ and v^ be column vectors whose 
entries are the components in the canonical base of the vectors 



p^,pf—^j , and ^p,,p,—^j (5.1) 

respectively. Note that Eu fcu|, = Id, since the entries of p^ are an orthonormal 
family of L'^ iJ~k) o-i^d — jp^ is a normed vector in iP' independent of pk- 
(N8) For k = 0, . . . , N — I let V^ , P^ be symmetric matrices defined by 

A/ 1 *^ 

^f^ ^= M E < [<r , Pi' ■■=mI1 P'^iPTT- (5.2) 

m=l m=l 

(N9) We denote by N the a-algebra of measurable sets A with ¥{A) = and set: 
jf '»" =a (Wf; < s < i) V AA, jg',™ = a {B';' - Bl^';t < s < t') V Af, 

M M 

m=l m=l 

tB 



Note that {J-t)i and \^irp\ are not filtrations. 
(NIO) In the sequel we will need to localize some processes using the following events 

%, := { Wf' - m < K \\P^' - id\\ < h] e F^fl V F^;^^\ (5.3) 

7V-1 
Af:=(^^,^Tr/'yT^J. (5.4) 

j=k 
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(Nil) For X = {xi, . . . ,Xm) G K^^, we denote \x\j^,j := jj Ylm=i 



5.2. Another look at the previous results. We introduce the following random vari- 
ables 



C^--=Pk--={\Pk\v^)vi, 



N,i,I 



7N,I 



where Cq is constant in the Lemma \4-^ Since Y^ '*' and Z^ ' are in Vk (see ()4.ip and 



(5.5) 



T2]) )■ we can rewrite these random variables as follows: 



Y, 



N,i,I 



tfe 



«fc -Pk 



i.I 



Pk, z^/ = i3i.pk = {piy 



where a^ (resp. P^) is the vector of the coefficient in the basis pk of the random variable 

■N, 



Yt, '*' (resp. Z^ ' ), identified with the column matrix of the coefficients in the canonical 



basis. 



Remark 5.1. Note that the vectors a^ and /3| are deterministic. 

The following Proposition gives a priori estimates ofY^ '*' and Z^ ' . 

Proposition 5.2. For i G {1, ...,/} U {oo} and for k = 0, . . . ,N, we have 



Y 



NdJ 



tk 



< 



Pk ' 



^/h 



Z 



N.I 



< C^ . Moreover, for every I and i = 0, . . . ,1: 



i,l 



<^ Pk 



Af|2 



' "' ~ h ' " ' 



(5.6) 



N,i,I 



Proof. Let i E {1, ...,/} U {cxd} and k = 0, . . . ,N. Squaring Y^ ' ' , taking expectation 



and using the previous remark, we obtain 

2 



E 



Y, 



N,i,I 
tk 



Ofc ^{PkPk)ak > Ofc Ofc 



ij 



a. 



Using Lemma 14.81 we deduce that 



ij 



"fc 



Y 



NdJ 



tk 



< 



a 



i,i 



A similar computation based on Lemma 14.81 proves that yh 

2 



< Cq. The Cauchy-Schwarz inequality implies 

Pk\ < \pk\ VCo < [\pk\ VCoj V 1. 

< C^ . The upper 



tk 



estimates of 



a 



i,i 



and \(3j.\ are straightforward consequences of the previous ones. D 



J'^ Rl 



We now prove that I a^ , /3^ I solves a minimization problem. 

Proposition 5.3. The vector ( ol^ , /3^ j solves the following minimization problem: for 
k = 0, . . . ,N — 1 and for every i = 1, . . . ,1, we have: 



^ (a,/3) 



i^fe+V - a.pk + hf i^Xt^ , a^ .pk, Z^^ 
•fr. 



NAA 



+ ASfe5 [Xf:^^^ , y,;^;;-^ j - f3.pkAWk+i 



(5.7) 
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Proof. Let {Y, Z) G Vk x Vk] then since Vk C L^ (-^tfc) and AVFjt+i is independent of Tt^., 
we have 



E 



Y, 



=E 



AT,/,/ _ 
ife+1 

NJJ 



-N T^N,i-l,I r^NJ 



rNJJ 



Y. 



y + hf[ xii , y,;— , zii'^) + Ai?,5 (^*t,, ^/:;r j - ^at^.+i 



tfe+1 
+ /iE 

1 



^Af,/,/ 



Z - T [YC:;' + ^^Bk9 <„r-r ) ) AH^.+i 



TV ^rNJJ 

f 
2 



/l 



-E 



/l 

2 



y,f;;'' + SB« .Y,t.,r,f;;'' A»..„ 



The mininiun on pairs of elements of Vk is given by the orthogonal projections, that is by 
the random variables Y = 1^,'*' and Z = Z^ ' defined by (j4.2p and ()4.ip respectively. 
This concludes the proof using the notations introduced in (j5.5p . D 



For i E {1, ...,/} U {oo}, we define 



Q 



i,i 

k ' 



vhPl ] ■ The following lemma gives 



lij 



some properties on i/^ . 

Lemma 5.4. For a// i E {1, ...,/} U {oo}, we have for k = 0, . . . ,N (resp. for k 
0,...,N-1) 



^]f 



<E|p^|'+E|Cf|', resp. 



qOO,/ 
''k 



<L}/i2^E|pff . 



oo./ 



Furthermore, we have the following explicit expression of 9, ' for Vk defined by ()5.ip ; 



r.OO,I 



E 



Vk (af^'^^.pk+i + hf ix^ ,a^' .pk,^i.pk) + ^BkQ [X^^^^,a^^^.pk+i 



k 



(5i 



Proof. Proposition 15.21 implies that 
Using inequality (I4.10p and Proposition 

J 



ij 



a. 



?/|2 



Ar|2 



+ /i|/3^r<E|p^^P+E|C 



^A|2 



5.2| since E |pfc| = 1 we obtain 



^r' 



E 



yN,oo,I _ -iAA,i,/ 



< L^h^'E 



Y 



N,ooJ 



tk 



<L}h^'E\p^\ . 



Using equation (j4.9p and the fact that the components of pk are an orthonormal family 
of L^, we have 



a,. =E 



Pfc^i 



A,oo,/ 



^{PkPk 



rNJJ 



-A -t^AfjOO,/ /yAf,/ 



n::^'+hf{K^nr''^Ki + ^Bkg[x;^^^x::. 



NJJ 



Pk (al'lyPk+1 + hf (x^,a'^'^.pk,Pi.pkj + A5fe5( fx^^^^, a^:|^.pfc+i 



=E 

A similar computation based on equation (14. ip and on the independence oi Ft^ and IS.Wk+i 
yields 

Vhpi =E [V^pfc<''' 



=E 
=E 
=E 



^^PkPk {yH;;' ^Wk^r + "^Bks «„y,f;('0 ^^^-^^ 



/,/ 



,,, AWfc+1 4- / ^ ^,j \ ATVfc+1 

Pfc ya^+rPk+i ^ + ^BkQ [Xi^^^,a^^^.pk+ij ^ 

AWfc+i / // uf(vN oo,/ o/ \ , Vd /'\^A /,/ 

Pk rj- \af:^^.pk+i + hf (^Xfc ,a^. .pk,Pk-Pk) + ^BkQ [X^^^^.a^^^.pk+i 
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Finally, we recall by (j5.ip that v^ := [Pk,Pk — TT^ ) 5 ^^^^ concludes the proof. 
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5.3. The numerical scheme. Let ^ : M — >■ M be a C^ function, such that ^{x) = x for 
|x| < 3/2, l^loo < 2 and |^'|oo < 1- We define the random truncation functions 



Pk (x) ■■= Pki\ N 
\Pk 



cf (x) := cf e 



^k 



(5.9) 



The following lemma states some properties of these functions. 

Lemma 5.5. Let p^ and Ck be defined by (I5.9p . then 

(1) Pi^ (resp. Cj: ) leaves Y^ ' ' (resp. VhZf. ' ) invariant, that is: 



-TV f I J 
Pk Ofc -Pk 



a/ -Pk, Ck (yhPk-Pk) = Vhpl.pk- 



(2) p^ Xk ^'"^ 1-Lipschitz and \Pk{^)\ ^ l^^l fo'r every x G 

(3) p^ (resp. Ck ) ^^ hounded by 2|p^| (resp. by 2\(^\). 



-N 



Proof. In part (l)-(3) we only give the proof for p^ , since that for (^ is similar 



1. By Proposition 15.2 



I.I 

Qfe -Pk 



Pf 



< 1. Hence, ^ 



1,1 



1,1 
P^ ■ 



2. Let y,y'GM; since le'L < 1' 

\p^{y)-P^{y') 



Ipfl 



pV Hpf 



< \y-y'\ 



Since /O^ (0) = 0, we deduce |p^ (x)| < |a;| . 

3. This upper estimate is a straightforward consequence of \i\^ < 2; this concludes the 

proof. D 



Let (X.^'"^)^<^<j^^, (AVF,'")i<„<jv^ and f AB™j be independent realizations 

of X^ , AVF and Ai? respectively. In a similar way, we introduce the following random 
variables and random functions: 



Ck ■=pk ■-- 

Cfc ^ (x) ■=Ck ^ 



\Pk I 



Sk 



' Pk i^) ■= Pk ^ 



N,m. ' ^ ^ 



(5.10) 



An argument similar to that used to prove Lemma 15.51 yields the following: 
Lemma 5.6. The random functions /3^ '"^(0 defined above satisfy the following properties: 

and is 1-Lipschitz. 



(1) Pi^ '™ is bounded by 2 



N,m 
Pk 



N,m 



(2) yO^ '™ and pj^ have the same distribution. 
We now describe the numerical scheme 
Definition 5.7. Initialization. At time t = t^, set Y. 



and /3 



,I,AI 



N,i,I,M 
ijv 



a 



N -PN ■■-- 



Pn^ (X, 






N 



Ofor ah i£{l,...,I}. 



N,iJ,M 



Induction Assume that an approximation Y^ ' ' ' is built for / = k + 1, . . . ,N and set 



Y 



N,I,I,M,m 

k+l 



.N,m I IJ,M 



Pk 



a. 



i ■P'k+i ) ^^^ realization along the mih. simulation. 



We use backward induction in time and forward induction on i. For i = 0, let a 



0,/,M 
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oO,I,M 
Pk 



0. For i 



1, . . . , I, the vector 6*^' ' 



a 



i,I,M 



, VhP}: ' ) is defined by (for- 



ward) induction as tlie arg min in (a, /?) of the quantity: 



M 



1 Sr^ \^N,I,I,M,m ra , r, ^ / x^A^,m i-l,I,M m ni-l,I,M m 



m=l 



+Ksr5 <-,y,f;('^'^'^- 



/3.p^AH-r+i 



(5.11) 



This minimization problem is similar to (j5.7p replacing the expected value by an average 



over M independent realizations. Note that 0^' 
vector. We finally set: 



i,I,M 



is a random 



Y, 



NJJM 



-AT 



Pk [»k 



IJ,M 



■Pk 



A ,VhZ^ 



N,I,I,M 



cr (Vhp, 



iJ,M 



■Pk 



The following theorem gives an upper estimate of the L^ error beetween {Y 



(5.12) 



and (y^'^'^'A/^ ^^,/,/,M^ ij^ tg^^g of 

We recall that by ^^ Af = 0^^"^^ { 
For fc = l,...,iV- 1 set 



nA^I. 



C and p ; it is the main result of this section. 



M 



M\'i 



Id 



>Af|2 



< h, \\P^^' - Id\\ <h]& T^'^'vTfJ. 



ek:=E\\vkvl-Id\\j,{E\p'^\ +E|Cf| )+E \vk\' {pk+il' ^\Pk+i\ 
\vk\ 



+ h^E 



|2 / 1 , I vN\^ , I |2Tr,lAr|2 , 1 , ,2,^1. at |2 



1 + |X-| +|pfc|^E|p-| +-|pfc|^E|Cf 



+ hE 



Vk\ + wt 



1 + 



tfc+i 



+ |pfc+i|2E|pf+i 



(5.13) 



Choosing N and then M large enough, the following result gives the speed of convergence 
of the Monte Carlo approximation scheme of Y^'^'^ and Z^'^ . 

Theorem 5.8. There exists a constant C > such that for h small enough, for any 
k = 0,...,N -I and M>1: 

N-l 



€m ■=E 



Y, 



NJJ 



tk 



Y 



NJJ,AI 



N-l 

<16^E 

j=k 



tk 



-AT 1 2 



+ hJ2E\z^'^-Z, 

j=k 



NJJ,M 



[(|Cil" + |PJ1"jlu-i 



^A|2 



A-1 



+ Ch^-' T. ih^ + hE\pf^,\' +E\pf\' + E\C^\ 



j=k 






hM 

j=k 

5.4. Proof of Theorem 15.81 Before we start the proof, let us recall some results on 
regression (i.e. orthogonal projections). Let v = (f™')i<m<M be a sequence of vectors in 



&". Let use define the nxn matrix V 



M ._ 



M l^ 



M 



M ■ 



M Z—im,=l 



^m^m.* ^ g^ppQgg i]xB,t V is invertible 



and denote by Amin {V^'^) its smallest eigenvalue. 

Lemma 5.9. Under the above hypotheses, we have the following results: Let {x'^,m 
1, . . . , M) be a vector in M^^. 

(1) There exists a unique M" valued vector 9^ satisfying 9x = arginf|x — 6.v\'i,r where 



\M 



9.V denotes the vector (Yl^^i 9{i)v^{i),m = 1 . . . , M). 
(2) Moreover, we have 9^ = jj {V^^)~^ T,^.=i ^'^^'^ ^ 1^" 
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(3) The map x ^ 9^ is linear from M^" to M" and Amm(^^")|6'x|^ < \Ox-v\m ^ l^lli- 
The following lemma gives a first upper estimate of ^m- 
Lemma 5.10. For every M and k = 0, . . . ,N — 1, we have the following upper estimate 



£m <E 



1,1 1,1, M 



N-1 

j=k 
N-1 



Pi - /3j'''^ 



+ 16E 



pf|'l[^M]=]+16 5]E[|Ci 



+ 16 2^E||C;| l^^Mi 
j=k 



This lemma should be compared with inequality (31) in |7]- 
Proof. Using the decomposition of y^'^'^, y^-^-^-Af^ ^A^,/ ^^^ ^a,/,/,m^ Lemma [53] (1) , 
we deduce 

2" 



eA/=E 






7V-1 
j=k 



:^Af 



^/^ 



^^^ kn^/^f^" 



i-^i 



v^ 



Pi 



Using hte partition A^^ , {^t^) where A^ is defined by ()5.4p . Cauchy-Schwarz's inequality, 



/,/,M o/,/,M 



Lemma 15.51 and the independence of ( a^' ' , /5j ' ' , ^a^' ) ^^"^ Pfc ^^ deduce: 



€m <E 



/,/ I,I,M 

Ofc -Pfc - "fc -Pk 



+ 2E 

N-1 



Pk "fc -Pfc 



+ 2^E 

j=k 

<e[H''-«I'' 

A-l 



■A 



+ 



j-Pj 



N-1 p 

j=k 

2 



^N I I,I,M 
Pk "fc -Pk 



[AfY 



+ 



7N ( /TnI,I,M 



vrr 



AI\ " * f 1,1 I,I,M 1 1 



+ /.E*^[(/'/-/'J"') W(^i-/'i-'-")^ 



j=A; 

+ 2E 
<^PkP*k^ 



Af 






A-l 



+ 2 



5:e[8|c 



'i I ^Ufl 



/,/ /,/,M 



j=fe 



'K' 



A-l 



+ /i ^ Ep,p*E 



j=fc 



^ _ ;3;>/>M 



LAf 



+ 16E 
This concludes the proof. 



Pk\ \aI'Y 



A-l 



+ 16 



Ei^ilc 



A|2 , 

'i 1 ^Ufl 



j=k 



D 



We now upper estimate 



^I,I,M _ qI,I 



lemmas below. By definition \\Vu'^ — I 



on the event A^^ . This will be done in severals 
< h on A^^ for any k = 1, . . . , N. Hence for 
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l-/i<A,,in(yrH) on^ 



\M 



(5.14) 



lieinma5.11. For every a ^W^ and k = 1, ... ,N, we have jj^^^^\a.p^\ < \a\ \\Pf 



k I 



Proof. The definition of tlie Euclidian norm and of P^ imply 



M 

M ^ 



i«-pri' 



a 



m=l 

this concludes the proof. 



1 *'^ 



.TO' /'„'^^* 



a 



^* dM ^ ^ II dJ\/| 



\a\ 



m=l 



D 



For i = 0, . 
l,...,Mby: 



, /, we introduce the vector x' 



,I,M 



i.I.m.M 



defined for m 



m=l, 



,M 



i,I,m,M 






/./(Xf'-,<'^'^.pr,/3f'^.p^ 



I tr Dm / vN,m ^N,m ( I,I,M m 

Using Lemma 15.91 we can rewrite equation (|5.11|) as follows: 



r,iJ,M 



■ arg inf 



i-lJM 



We will need the following 

Lemma 5.12. For all k = 0, 

-rrW,M ., T~B,M , , 

J-rp y J-, rp measurable. 



^■^r 



.N 



2 

M 



A/ 



M 



V, 



M\ 



m.=l 



i-l,/,m,M 



4" 



(5.15) 



(5.16) 



/,/,A/ 



1 and every I, the random variables a^ ' are 



(resp. 



Proof. The proof uses backward indution on k and forward induction on i. 
Initialization. Let k = N — \. By definition aj^^-^ = 0. Let i > 1 and suppose a^Ji ' 
F^'^ V F^'^' J,. Using ^^ (resp. ([521)), we deduce that v^^^-^ G F^'"^ V jf '^ 

y^^_,G^r^^v^f;_^l^). 

Futhermore (|5.15p shows that x'^Ji '™' G -Fj. ' M F^ '_ rp and hence ()5.16p implies that 



'AT- 



tjV-l:T' 



Induction. Suppose that cej,^"] G Frp ' V J^^ ' j,; we will prove by forward induction on 



i that a^' ' G Fj, ' V F^ 'j, for i 



0,...,/. 



By definition a^' ' 



-VK,A/ , 



-B,Af 



n c i-l,I,M ^ -^W,M ,, -T-B^M ,, . i,I,M ^ 

U. Suppose df. G J-^ W J-^ ^ ; we prove that aj^ G 



Fj, ' y F^ 'j, by similar arguments. Indeed, (j5.ip (resp. (|5.2p ) implies that v'^ G J-'^, 



W,m 



-B,m 



-W,M , 



-B,A//x 



F^^f (resp. 14^ G J7 "^J^tS)^ w^il^ (!5T5]l (resp. (|5T6]l ) yields ..;- 



V 



i-l,I,m,M ^ T~W,M ,, 



-B,A^ 



•^ifcir (resp. a 



,/,Af 



G j; 



W,M 



-B,M 



y F^ 'rp). This concludes the proof. 



D 



The following Lemma gives an inductive upper estimate of 



i+l,I,M 



r,i,I,M 

^k 



Lemma 5.13. There exists C > such that for small h, for k = 0, . . . ,N — 1 and for 



h...J-l 



YJ+l,/,A.f 



r.i,I,M 



<Ch 



:,i,I,M 



r.i-l,I,M 

^k 



on Af . 



Proof. Using ()5.14p and Lemma 15.91 (4). we obtain on A^ 

2 



M 



{l-h) 



^k 



r,iJ,M 



< A, 



[yi') 



ni + l,/,A-/ 



,i,I,M 
k 



< 



iJM 



i-lJM 



2 

M 
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h^Lf .ili, /i/ .... . , ...\ 2 
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(l-h) 



vi+l,I,M 



:j,M 



2 h^- '' 
< - 

M 



'f 



E 

m=l 



a. 



.,I,M 



a. 



-1,I,M 



■Pk 



, I / ni.I.M ni~l.I.M\ 

+ I ( /5fc - /3fc j -Pk 



Lemma 15.111 and the inequahty ||P^^|| < 2, yield 



{l-h) 



h -^k 



< 



i,I,M i-l,I,M 

— OLi. 



a. 



+ 



oi,I,M oi-l,I,M 
Pk -Pk 



M\ 



h'Lf\\P^, 



<2hLi 



■ni.I.M ni-l.I.M 



This concludes the proof. 



D 



For e = (a, y/hp) set FkiO) := arginfg. xl'^^O) - 9*. 



Vk 

■fr 



where 



Lemma 5.14. On A^ , the map F^ is Lipschitz with a Lipschitz constant 2hLf{l — h)~^ . 



Proof. Using (I5.14p and Lemma 15.91 (3). we obtain on A 



M 



(1 - h) \Fk {01) - Fk (02)1' < Amin «) Wk (0l) - Fk (02)r < 4' (^l) " 4' (^2) 

Using the Lipschitz property (j2.3p of /, Lemma 15.111 and the inequality ||-P^ || < 2, we 
deduce that on A^^ : 



h^L 



M 



(1 - h) \F, (Or) - F, {02)1' <—f- J2 {\^^-Pk - oc2.p1:? + l/3i.pr " h-Pl 



m=l 



< \ai - ai? h^Lf \\P^\\ + |/3i - 132? h^Lj ||Pf | 
<2hLf\ei-e2?; 
this concludes the proof. 

The Lipschitz property of Ff^ yields the following: 



D 



Corollary 5.15. (i) For h small enough, on A^^ , there exists a unique random vector 



qOo,I,M 



oo.I.M 



a. 



,Vh0 



oo,I,M 



such that 



M 



C'^'" = If iyiT E <'^'"^'"-r = arginf 



m=l 



I.M f qoo,I,M 
^k 



f.Vk 



2 

M 



(5.17) 



where for 9 = I a, v/i/3), XjJ (6) := (x^''"' {6)] denotes the vector with com- 

V / V /m=l,...,M 

ponents 



I ,m,M / n\ ^N,m f I, I.M m \ , i, j: I x^Afjm mom 

^k W ■=Pk+i y^k+i -Pk+i) + hf l^Xi^' ,a.pf,,f3.pi^ 

I ■^ om f vN,m ^N,m ( I,I,M m 

+ ABi,g (^^i,;^ ,Pfc|i (^a^+i -Pk+i 
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Let X 



oo,7,M 



oo,I,m,M 



X 



Lm,M ( qOO,I,M 



m=l,...,M \ \ / / m=l,...,M 

(ii) Moreover there exits a constant C > such that for small h and any k = 0, 



iV-1 



nOO./.Af 



qI,I,AI 
^k 



< Ch^ 



ooo,/,M 



Proof, (i) This is a consequence of Lemma 15.141 since 2/iLj(l — h) ^ < 1 for small h. 
(ii) An argument similar to that used to prove Lemma 15.141 implies that for i = 1, . . . ,1 



nOO,7,M 



I,I,M 
k 



Since 6' 



0,1, M 



{1-h) 

0, we conclude the proof. 



<2hL 



nOO,/,A/ 






D 



The following result, similar to Lemma l4.4| will be crucial in subsequent estimates. It 
requires some additional argument compared with similar estimates in [7j. 

Lemma 5.16. Let U]^]i be a J-j, ' V J-" ' ^ measurable random, variable. Then we have 



E 



i^mUI^^^abi 



0. 






Proof. Using ()5.3p and ()5.4p we deduce 

Recah that 2tfc = {\\V^'^ - Id\\ < h, \\P^^ - Id\\ < h}. We wiU prove that 

l^^=f(%Bl...,%B, 



4' 



(5.18) 



with a symmetric function /, that is / (/3i, . . . , /3m) = / (— /3i, . . . , —/3a/) for any /3 G 



Suppose at first that (15.18J) is true. Since the distribution of the vectors ( AS^, . . . , Ai? 



and 



-^Bl. 



<— - 






-rW,M ., -r-B,M ■ 1 , 

J-rp y J-^ rp yields 

E CKbi^i^^ 



- ABJfj are the same, the independence of ( AB^, / = 1, . . . , M j and 



■j~W,M , , -p 



i- _ 



^'"'^ K(^Brf(^Bl...,^Bt 



=E 



V 



<r- _ 



AB^f -ABl...,-AB^ 



yM 



E(ABrf(ABl...,%BJf)) 



Which concludes the proof. 

Let us now prove ()5.18p . Clearly, it is enough to prove to prove that each norm involved 
in the definition of 21^ is of this form. Let A be one of the matrices V^ or P^ ■ Now 
we will compute the characteristic polynomial x of the matrix A — Id and prove that its 
coefficients are symmetric. 



Let g"* be p'^ or v'^'^. We reorganize q"^ as g^ 



,t-- 



f- 



g™ , (?^ A 5^ I , where q^ are the 



elements of g™ independent of Ai?™, and g^ is independent of AB^. So we have 



g™ (g'")* 



qTiqT 



<— _ 



Qi [12 ) ^Bf, 



q^{q^r AB^ 



\ Q2 iQi > ^Bf^ 

Let A = jj X]^=i g'" {q^)*] then the characteristic polynomial of the matrix ^ — Id is 
given by 



X{A- Id) {X) = det 



B-{X + l)Id 



C* 



C 



D-{X + l)Id 
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where 



M 1 ^ 

^ ■■=M ^ ^"^"'* ^ ^^^^^^ ('^^ ' ^ ^= M ^ C92™'*^i?r e M,,x7. (M) , 



m=l 

A/ 

^ - M 2^ ^2 92 



m=l 



M 



m,=l 



^i?r 



GM/. 



2X/2 



Set Ji = {1, . . . , /i} and J2 = {/i + 1, . . . , Ii + I2}, and for o" G 6/1+/2 the fohowing sets 
"^(0, a, P) = {i £ Ja, o-{i) G Jg} , for a, /3 G {1, 2}. Usmg the definition of the determinant, 
we have 

x{A-Id){X)= Yl <<') n [B{i,a{i))-{X + m^„^,^] 

n C{i,a{i)) H C{a{i),i) n [D{i,a{i))-{X + m^^^,~^] 

ie'H{l,a,l) i£'H{2,a,l) ie'H{2,a,2) 

Since we have the relation 1?^ (l,cr, 1)1+1?^ (l,cr, 2) I = |Ji| = /i and |?^(l,a, 1)|+|^(2, a, 1)| = 

I Ji| = Ii, we deduce that |^(1, cr, 1)| + \'H{2, a, 1)| is even. Therefore, the power of A.BJ^ 
in x(A — Id){X) is even, which concludes the proof. D 

As a corollary, we deduce the following identities 
Corollary 5.17. For k = 0, . . . , N — 1, we have 



E 
E 



M 



m=l 



1 V^ ^N.m I I.I.M m \ V om / vN,m ^N.m I I.I.M n 



t+1 



1 /-7V,m / 7,7 m \ ^N,m ( I,I,M m 

l^f [Pk+l [(^k+l-Pk+l) -Pk+1 («fc+i -Pk+i 

V om / / vN,m 1,1 rn \ ( vN,m ^N,m ( IJ,M m 



(5.19) 



(5.20) 



Proof. Indeed, X^ '^ G Tj, ' . Futhermore, (|5.1U|) . Lemma [5. 121 and the definition of p^_^_^ 



l^k + l 

~JV,m / 7,7,M 



-^N,m f 1,1 



imply that ^^^ (^a^'^ .p^+^j ,p^^ (ofc+i-^fc+ij G -^t ' V -^i^;^,^- Thus Lemma EH] 
concludes the proof. D 

The following result provides an L'^ bound of u^ 



in terms of p^^- 



Lemma 5.18. There exists a constant C such that, for every N and k = 0, . . . ,N — 1, 



E 



K' 



30o,7,M 



< cE\p^^^y + ch. 



Proof. Using (|5.14p . Lemma 15.91 (3) and Corollarv 15.151 (i) we have on A^ 



M 



{l-h) 



qOO,I,M 



< Amin(^- ) 



qOO,I,M 



< 



oo,I,M 
X,. 



2 
M 



Using (Nil), taking expectation, using Young's inequality and (|5.19p . we deduce for any 
e >0, A; = 0,...,iV-l, 



(1 - h)E 



'^¥ 



nOO,7,A7 
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^"'«-i('+7)i:^ 



m=l 

M 



Pk+1 (^"fc+i -Pk+i 



m=l 
^ ^ m=l 



l^A/ 



m oOO,I,M m 
■Pk ) Pfc -Pfc 



f[^t: ,o^k ■ 

tr om / vN,m ^N,m ( I,I,M m 

^Bf^g (^X,^,;^ ,p^;^ (^a^'i .p;-,+i 



Lemma 15.61 yields 

T'-"m < 4-^ (1 + ^) E E 

^ ^ r?i=l 

hi1 

^^ imply 



I N.m 
\Pk+l 



<4(l + ^)E|p^^l|^ (5.21) 

The Lipschitz condition (j2.3p of /, Lemma 15.111 and the inequalities -P^ < 2 valid on 

/4, imnlv 



1 ^ 

T,^'^^(2)<2L;M/^ + 2e)-j; 



E 



771=1 



'^f 



a 



00, 1, M ., 



■Pk 



+ 1 



k 



oOO,I,M m 
Pk -Pk 



M 

+ 2h{h + 2e)-^E\f[x^'"^,0 

m=l 

<2Lfh{h + 2e)E I I^a 
<ALfh{h + 2e)E 







iA/ a 



oo,I,M 



'^f 



k 
00,1, M 



p: 



,00, I, M 
'k 



/5; 



,00, I, M 
'k 



WPi'WJ +2h{h + 2e)E\f {Xi[,0,0 

+ 2h{h + 2e)E\f {X^^,0,0)f . 

(5.22) 



Finally, since Ai?™ is independent of J-"^ ' Vj-"j ' ^ for every ?tt, = 1, . . . , M, the Lipschitz 
property (j2.4|) of g and Lemma 15.61 (1) yield for m = 1 "'^ 



,...,M 



E l^M 



■^T Dm. / vN,m ^N,m ( I,I,M m 

^^fc5(^t,;,,Pfcli ("feVi -Pk+i 



=E 
=E 
</iE 



l^M . l^fe 



1, 



fc+i 



'^k+l 



tr om / x^Af,m ^N,m [ I,I,M m 

ASfc g (^x,^;^ ,Pfc;i (^a^'i .Pfc+1 



< SLqhE 



( vN.m ■^N,m ( I,I,M m 

9[Xt,[,,Pk+i [ak+i -Pk+i 

( vN.m ^N,m. ( I,I,M m 
9 ^^t,+i , Pk+l ^«fe+l -Pk+i 



E I 



%Bf 



I -pW,M j-B,M 

1 tjV tfe+l,J 



4 A/ 



N.m 
Pk+1 



+ 2/iE 



L4A/ 



K<;:'0 



Therefore, 



JM.o. .c .^;, {i + -)e \p^^,f + 2h(l + ^\E 



n^i'O 



(5.23) 
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The inequalities (|5.2ip - (|5.23j) imply that for any e > and h G (0, 1], 



(1 - h)E 



■,oc,I,AI 



<<i4( 1 + ^j +8Lg/iM +^ 






oo,/,A/ 



+ 



/3: 



oo,I,M 
k 



+ ALfh{h + 2e)E 

+ 2M/i + 2e)E|/(X/^,0,0)|' + 2/i(^l + :^)E|5(x,^^,,0 

Choose e such that 8Lje = 4 so that 4Lj(/i + 2e) = i + 4:Lfh. For /i small enough (that is 
h < , -^ 1. ), we have ALf{h+2e) < ^{1—h). Hence, we deduce ^(1— /i)E1^a/ 
CE |/Ofc_|_i| + Ch, which concludes the proof. 



100,7,4/ 



< 



■)IJ,M nlJ 



The next result yields an upper estimate of the L -norm of 0^' ' — 0^' in terms of 

Lemma 5.19. There is a constant C such that for every N large enough and all k = 
0,...,N-1, 



E 



tUM nU 



< (l+C7/i)E 



^f 



rjOO,I,M noo.l 
4 - ^fc 



J-l 



Af|2 



+Ch'-'{EW^ +Eci: 



>Af|2 



Proof. We decompose 6,' ' — 9,' as follows: 






-,00, 1, M aOO,I\ _|_ I nlJM noa,I,M 



i/,/ flOO,/ 



Young's inequality implies 

'=(1 + /!) 



a/,/,M nl,l 
h -^k 



oo,I,M qOO,I 
k -^k 



2 f 1 



^^•' - C-' 



+ 



h -^k 



Taking expectation over the set A^^ , using Lemma 15.41 and the fact that a^ and /3^ are 
deterministic, we deduce 



E 



h -^k 



<(l + /i)E 



+ 2( 1 + - IE 



h -^k 



Iu2Itw \„N\ 



+ 2(l + -)L}/i-E|p^^ 



^Af 



iI,I,M _ aoo,I,M 
k k 



nOO,/ • 



Since 6"^' is deterministic. Corollary 15. 151 (ii) and again Lemma 15.41 yield 



E 



'^f 



h -^k 



<Ch^E 



'^¥ 



nOO,/,A/ 



<Ch^ (e Ipf 1^ + E |cf n + C/i^E 



nOO,7,M nOoJ 



Therefore, we deduce 



E 



'^¥ 



\ -^k 



<(l + /i)E 



+ 2 1 + 



h -^k 



+ 2(^l + i)c/i^(E|p^|'+E|C 



Ar|2 
A: 



h 



Ch^E 



tOO,/,M /lOO,/ 



+ 2( l + -)L}/i2^E|/)^|^ 



<(l + C/i)E 
which concludes the proof. 



'Af 



nOO,/,A/ oOO,I 

h -^k 



+ c/i^-i(e|/,^|' + e|c 



Ar|2 



D 
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The rest of this section is devoted to upper estimate 9^' ' — 9^' on A^^ . We at first 
decompose 0^' — 9^' ' as fohows: 



k -^k 



E's^' 



(5.24) 



i=l 



where 5S2, ^Ss and 5^5 introduce a Monte-Carlo approximation of some expected value by 
an average over the M-realization: for A: = 0, . . . , A^ — 1, 



^r:=[Id-{vi'y')9^\ 






M 



TU< l ^ly l 1,1 W ^ ST^ m^N,m ( 1,1 m 

IE [vkPk+i [ak+i-Pk+i] ) - 7T 2^ ^fc Pk+i I «'^ "^ 



?A^ 



m=l 



^k+l-Pk+l 



1 ^' 



k-Pk 



^-=^W')-'E 



M 



M 

^k 
m=l 



m=l 
'^N.ni ( 1,1 m \ ^N,m ( 1,1,M m 

Pk+i [(^k+vPk+i) -Pk+1 («fe+i -Pk+i 



I u s I -vN,m oo,I m nl m\ u s I -^^,171 oo,I,M m nOO,I,M m 

+ hf l^X^^' , a^ .pk , /3k.Pk ) -hf l^Xi^' , a^ ' ' .Pk,Pk -Pk 



+^i?r 



/ vN,m ^N.m f 1,1 m \\ ( v^.m ^N,m ( 1,1, M m 

9 [Xt,+,,Pk+i ( ttfe+i-^fe+i ) ) - 9 [Xt,+,,PkU («fc+i -Pk+i 



^^■■={Vk'r' 



M 



E ( vSb.o fxf . ^ , af/. .p... ^^-^f2 ^r^^r^ «C' /^S ^ " ''' 



VkAB^g iX^^^^,af:^^.pk+i 



M 



(^k+vPk+i 



m=l 



Note that compared to the similar decomposition in [3, ^4 is slightly different and 5S5 is 
new. Indeed, using equation (|5.8p and (|5.17p and Lemma l5.5l (1). we obtain: 



900,/ nOO,l,M 
k -^k 



k 



id-{vi') ^)er + [yk I ^k --k 



=^1 + {Vi") ' E [vk {aii,.pk+i + hf (Xf , a'^^^pk^Plpk) + ^AB^g [x^^^ , a^^.p^+i 



1 

M 



M 



{Vk'T'E^k 

m=l 



'^N,m ( 1,1, M m \ , 1 j: ( vN,m oo,l,M m nOO,l,M m 

PkU «fc'+i -Pk+ij+hfiX^^' ,afc ' ' .Pk ,/3fc ' ' -Pk 






^ r M M 

■^ M ^ '' ^ Z^ ^fc Pfc+l l^«fc+l-Pfc+lJ - Z^^k Pk+1 \'^k+l -Pk+l 



ie{l,2,3,5} 



.m=l 



m=l 



M 



m=l 
M 



^fi^t, >"fc -Pk :Pk-Pk - hf [X^^' ,a^ .pk ,(3j^ .p^ 



+ i7(^^'')"E-r^^. 



M 



I vN,m ■~N,m ( 1,1 m \\ ( vN,m ^N.m ( I,I,M m 

9[Xt,+,^pkU [»k+vPk+i)) -5(^i,;,,Pfe+i ("fcVi -Pk+l 



m=l 



which concludes the proof of (j5.24p . 
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The following lemmas provide upper bounds of the error terms *Bj. Recall that if F is 
a matrix such that \\Id — F\\ < 1, then F is inversible, F~^ — Id = Ylk>i('^^ ~ ^)^ ^^"^ 



\Id-F 



-ii 



\Id-F\\ 



^ i-\\M-F\\ ('^■^^' 

Indeed, F-i = {Id- {Id- F))~^ = J2k>oi^d-F)^and \\Id-F-^\\ < Efc>i IK-^^- ^)''ll- 
Lemma 5.20. (i) Let {Ui, ...,Um) be a sequence of iid centered random variables. Then 

2 



we have E 



^J\/ 



V" u 



MElf/i 



^A/ 



(ii) We have E Y.tn=i « «)* " Id) = ME\\vkvl - Idfp. 

F 

Proof, (i) The proof is straightforward, 
(ii) Using (i) (N6) and (N7), we deduce 

2 



E 



M 



E [^^" ( 



^D* 



Id] 



m=l 



-E^ 



«J 



M 



Y,[vr{v'^r-id]{i,j) 



m=l 



--MY,^\[vk {vkT - Id] {i,jf = ME\\vkvl - Id\\ 



2 . 



«J 



this concludes the proof of the Lemma. 



D 



The following lemma provides a L upper bound of !Bi. Recall that A^ is defined by 
(El. 



Lemma 5.21 (Upper estimate of 5Si). There exist a constant C such that for small h 
and every M > 1, 



E 



I^Siri, 



<^nHvl-Id\\l(E\p^\' + E\C^\' 



Proof On A^ we have \\Id - V^^'^\\ < h < 1; and hence (IST^ implies \\Id - (y^*"^)"^!! < 



||M-yM|| 

l-||/d-V/^| 



< 



\\Id-V^' 
1-h 



-. Using the inequality ||.|| < ||.||i? we deduce 



E 



A/\-l||2i 



\id-{vtr'riMi 



< 



1 



rE 



'^¥ 



/d-W 



A/||2 



(l-/i)2 

By definition F^^ = ^ Y^f^^i ^k «)*; so using LemmaEZOlwe obtain E [i^m \ld - V^fp 
jjjE}\vkv\ — /(illl'. Therefore, since (f^' is deterministic. Lemma [53] yields 



< 



E 



|*Biri 



K' 



< 



gOO,/ 



E 



'k ) II ^Af 



\Id-{Vfn-'\\n,M 



c 



.JV|2 



>7V|2 



<^{E\p'^\^+E\Ci:f]E\\vkvl-Id\\h 



M\-l 



on Af . 



this concludes the proof. 

The next lemma gives an upper bound of (V^^) 

Lemma 5.22. For h G (0, i), we have ||(F/0~1 < 2 on A^' . 

Proof. Using the triangular inequality and inequality (|5.25p . we obtain on A^^ 



D 



\\{V^'')-'\\<\\Id\\ + \\Id-{V^'-') 
Since /i < oi the proof is complete. 



M\-l\ 



< 1 + 



\\Id-V,,^'\\ 



< 1 + 



1-h 1-h 



D 
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The following result provides an upper bound of ^2- This estimate should be compared 
with that given in [7] page 2192. 

Lemma 5.23 (Upper estimate of ^2)- There exists a constant C > such that for large 
N andk = 0,...,N -1,E 



< — E 



I ^2 1 Ia" 
Proof. We can rewrite 5^2 as follows: 

m y^k ) V^ / m^N,m ( I J m 



\Vk\ \Pk+l\ 



^l/'fc+il 



M 



m=l 



E 



^N f 1,1 

VkPk+1 [a^^i-Pk+i 



Using Lemmas 15.221 and 15.201 (i). we obtain for small h 

M 



E 



l»2ri, 



>2| i^f 



4 ^ 

< — ^E 
- M2 



m=l 



El m^N,m I 1,1 






E 



VkPk+l ( Ofc+i-Pfe+l 



< — E 
-M 



VkPkA 



-1 (afc+i-Pfc+i) -E ^^;fcpf_^_i (a^:|i.pfc+i 



< — E 
- M 



VkPk+l ( Ofe+l-Pfc+l 



/,/ 



Using Lemma 15.51 (2), Cauchy-Schwarz's inequality and Proposition 15. 2t since o-f^,^ is 
deterministic we deduce 



E 



1 532 1 l^f 



< — E 
-M 



\Vk\ 



aiirPk+i 



4 

< — E 
- M 



kfcHpfc+il^ 



Elpf+if, 



which concludes the proof. 

The next lemma gives an upper estimate of the L^-norm of ^3 



D 



Lemma 5.24 (Upper estimate of 5S3). There exists a constant C such that for large N 
and k = 0, . . . ,N — 1, 



E 



Af I^SsI 



~ M 



\Vk\ \l+\Xf,\ +\pk\E\p,,\ +-|pfc|E|Cfc| 



Proof We take expectation on A^^ , use Lemmas 15.221 and 15.201 (i): this yields for small h 



E 



Uf l^sl 



<4— Eflufc'^ 



f(x^,a^''.Pk,^i.Pk 



(5.26) 



The Lipschitz condition (12. 3p . Cauchy-Schwarz's inequality and Proposition 15.21 imply 



r I -i^N CO, I nl 

f [Xj. ,afc ' .pk,Pk-Pk 



<2Lf{\X^f + 



oo,I 



+ \f3i.pkn+2\f{0,0,0)\' 



<2Lf (^\X^\' + \pk\'E\p^\' + ^\pk\'E\C^\'^ +2\f{0,0,0)\' 
which together with (|5.26p concludes the proof. 

The next result gives an upper estimate of 5^4 in L^. 



D 



Lemma 5.25 (Upper estimate of 5S4). Fix e > 0; there exist constants C and C{e) such 
that for N large and k = 0, . . . ,N — 2, 

{l-h)E l^M|*B4p <(l + C(e)/i)E I^m q' ' 

+ C{h + 2e)h[E 



fe+i 



/,/ 



I,I,M 
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k+l "fc+1 



00,7 00, I, M 

-a. 
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+ E 
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f^i - f^k 



00, 1, M 
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Proof. By definition, we have "B^ = jj {V^^) Em=i v'/^xf. Let x^ := (x^, m = 1, . . . , M); 
tlien Lemma[5J]and inequality (fSia imply that on Af, (l-/i) |«B4|^ < Amm(V^^O l^4|^ < 
|x4|j^j. Taking expectation, using Young's inequality and (|5.20p in Corollary 15.171 we ob- 



tain for e > 0: (1 - h)E \ 



1 AM 1^4] 

M 



< Yli=iTi, where: 



e M 



m=l 



■^N,m (1,1 rn \ ■^N,m ( I,I,M m 



To:-- 
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r / vN.m oo.I.M 



m oOO,I,M m\ 
■Pk ' Pfc -Pk J 






m=l 



< 



"abv^ 



I ^i^N,m ^N,m ( 1,1 m 



Lemma 15.61 (1) and Lemma 15.111 yield 



m=l 



/ vN.m ^N,m ( 1,1, M m 
-9[Xt^+,,Pk+l [»k+l -Pk+i 



1,1 m I,1,M m 

"^k+l-Pk+l - "fc+1 -Pk+l 



\M 



< I 1 + - IE 






a 



I,I,M 
k+1 



\pM I 
P fc+ll 



M 



Since ^f C ^^'^i and ||Pfc+i|| < 1 + /i on Af , we deduce 



Ti < ( 1 + - ) (1 + /i)E 



L4A/ 



a 



.1,1 

k+l 



a 



I,I,M 
k+l 



(5.27) 



Using property (j2.3p . Lemma 15.111 and a similar argument, we obtain for < h < 1: 



T2 < L//i {h + 2e) E 
< 2L//i(/i + 2e)E 



^^r 



00,1 



a. 



a. 



00,1, M 
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Pi - /3i 



,00, /,M 
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00,7 



a. 



00, I, M 



a. 



+ 



/5i - /3,° 



00,/, A/ 



(5.28) 



Finally, since A^^ = A^{^^ n 21^ and ABJ^ is independent of T^^ V J-"^^ y, we have using 
the Lipschitz property i\2A\i : 



M 



m=l 



aM 



vN,m ^N,m ( 1,1 m \\ ( vN,m ^N,m ( 1,1, M m 



E 1 



L^fc 



V- 



Asr 



r tjv tfc+i,-' 



< 



v=(i4)^EE 

^ ^ m=l 



fc+i 



PkU [ak+vPk+i) -Pk+1 («fc+i -Pk+i 



So using Lemma again [5^6] (1) and Lemma l5.11l we deduce 



Ta <Lgh ( 1 + ^ ) (1 + /i)E 



V AM 
^k + 1 



1,1 



1,1, M 



"fc+1 "fc+1 



(5.29) 
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The inequalities (|5.27p - (|5.29p conclude the proof. D 

We decompose v^ as Vk = ("V^, v^ where f^ contains all the elements in the basis which 



are independent to AS^ and v^ = —^w^. with w^ independent to AS^. The next 

lemma gives an upper estimate of the L^ norm of 5S5 on Aj^ . 

Lemma 5.26 (Upper estimate of 5S5). There exists constant C such that for small h and 
k = 0,...,N -1, 

\vk\ +KI 



E 



l.M I^Bsl 



Ch 

< E 

- M 



"^'^^'i + Ki|' + iP.+ipE|p^^il 



Proof. The proof is similar to that of Lemma 15.241 which deals with 5S3. Lemmas 15.221 
[520] and ES] (1) yield for smaU h 
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Af I ^5 1 



4 ^ 
< — E 
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< — E 
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Ad I vN ^N I I.I 
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V_ 



^N WV 



VkABkg lXt^^^,Pk+i (ofc+pPfc+i 



/,/ 



VkABkg yX[l^^,al'l^.pk+i 
Then the decompostion of Vk yields 
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L^A/ I^Bsl 
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-M 
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vlABkg [Xt^^^,a^'^^.Pk+i 



H E 
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I.I 
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Since ABk is independent of Fjf V Fj^ ^, we deduce 
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l.M I^Bsl 



< — E 
-M 



Ch 

< E 

- M 
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< E 
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H E 

M 
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|2 I I p|2\ /x-AT /,/ 

^fcl +\K\ ) 9[X^^+,^a^^^.pk+l 



The Lipschitz condition ()2.4p . Cauchy-Schwarz's and Young's inequalities together with 
Proposition 15.21 yield 



/ x^TV /,/ 

9[Xt ,a^+^.Pk+i 



This concludes the proof. 
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+ |pfc+i|2E|pf+i|' 



2|5(0,0)r. 
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Final step of the proof of Theorem 15.81 Young's inequality implies that for h G 
(0, 1], (61 + 62 + ^3 + ^4 + hf < t(^? + bl + bl + bf) + (1 + h)hl. Recall that efc has been 
defined in ()5.13p . Then the decomposition (j5.24p and Lemmas 15. 21 1 and 15. 23115.261 yield for 
e > 0, small h and e^ defined by (|5.13p : 
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fc+i 



^A?^ 



/J 



153, 



je{l,2,3,5} 

ij,m\ 



+ (l + /i)E 



1 .Af I5S4I 



Ofc+l - "fc+l 



+ (l + C7/i)C7(/i + 2e)/i E 



00,7 



a. 



00, 1. M 



Oi 



+ E 



/3i - /5,^ 



oo,/,Af 



REGRESSION MONTE-CARLO FOR BDSDE 



37 



where in the last inequahty, we have used Lemma |3.7[ The definition of 6^' ' and 9"^' , 
yield for h small enough: 

[l-{l + Ch)C{h + 2e)h]E l^M aT'' -aT''''" + hE 



<^ek + {l + C{e)h)E 



AM 



/,/ _ I,I,M 



/3i - f^k 
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'^¥ 



f^i - K 
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Using again Lemma 13.71 we obtain for some constant C and h small enough 
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<^e, + {l + C{e)h)E 



+ {l + Ch)C{h + 2e)hE 
Using Corollary 15.151 (ii) and Lemma 15.181 we deduce 
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(5.30) 
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(3i - p'/^'' + Ch'~^E \p^^,\' + Ch'. (5.31) 



Plugging (j5.30p and (|5.3ip in Lemma 15.191 we obtain for some constant C and h small 
enough 
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But (1 + Ch)C {h + 2e) = 2eC + h{C + C^h + 2eC^) and we may choose e such that 
2eC = i, so that 1 - (1 + Ch)C {h + 2e) = ^-{C + C'^h + f )/i. Using again LemmaEZl 
we obtain for some constant C and h small enough: 
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So for small /i, 
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Using the Lemma 13.71 we obtain 
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The Gronwall Lemma 13.81 applied with a^ = E 

2 



/./ 



a. 



a,. 



IJ,M 



and Cfc = /liE 



/3, 



IJ,M 



Pi 



and the fact that a^ ' = a^ concludes the proof. 
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